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The Nature and Organization of Supervision 
By S. A. Courtis, Director of Instruction in the Detroit Public Schools 


I am going to speak to you today about a philosophy of super- 
vision. Some people do not have much use for philosophy, but if you 
will examine present customs you will find that most of them are tied 
very tightly to the past. We tend to do the thing which custom has 
established, and, what is more important, we tend to keep on doing it 
a long time after we should change. Most progress comes as a result 
of pressure from society. Society changes and the school lags 
behind continuing the old customs until society becomes impatient and 
forces us to change. It seems to me that it is a more intelligent pro- 
cedure to consider what we ought to do in any situation. We may not 
always be able to carry out every detail of rational plans but at least 
if we know what we ought to do we can move toward the ideal bit by 
bit. From my point of view, therefore, philosophy serves to set up the 
ideal, to supply a vision which shall furnish a pull towards progress, to 
take the place of the push which comes from society under conventional 
conditions. 

Now the distinct philosophy of Americans is that which believes 
in getting results. Americans pride themselves upon being “go-getters.” 
They act first and reflect afterwards. The ordinary school superintendent 
boasts that he is a practical man. He does not have much use for theory 
and philosophy. Of course, the superintendent must be practical. His 
job depends upon it. He is an executive officer. But my contention 
is that there is nothing contradictory between practice and thinking in 
an idealistic way about the principle which underlies achievement. My 
plea is for a happy combination of the two aspects of action. 

Let us begin by considering the evolution of our present school 
organization. The original school in this country was the Dame School 
of the Colonial period. Some good housewife undertook to take care 
of her neighbors’ children and to teach them a few of the common 
essentials as well. These schools prespered, and as the number of the 
children increased, it was necessary to divide them into several depart- 
ments. In the schools of Boston about 1845 there were two separate 
departments: a junior, which included all the children under twelve, and 
the senior, which included the children over twelve. These schools were 
ungraded, but not long afterward the idea of grades was introduced. 
The buildings in which that period prided itself were the conventional 
seap-box buildings with a room for every grade, a style which has been 
typical of school architecture from that day to our own. 

Recently, however, we have had the development of a new type of 
school organization, the modern departmentalized school. While this 
has classrooms, special laboratories, library, auditorium, gymnasium, 
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etc., the actual organization of a platoon school calls for a degree of 
coéperation between teachers, and for a common school life which repre- 
sents a very different type of organization from that found in the con- 
ventional school all these years. 

If now you will consider the skeleton of organization that has 
evolved thru these periods you will see that originally the teacher was 
administrator, financial agent, supervisor, attendance officer and every 
other type of officer. However, as soon as the schools grew large enough 
so that more than one teacher was required it was inevitable that one 
should become the head teacher. Similarly, when there were many 
schools and many principals, there was need for a master principal or 
superintendent. So far in our organization scheme we have a line 
organization; there is direct connection from superintendent to principal 
to teachers. The time came, however, when the superintendent, visiting 
thruout the system, found in one room, let us say, a teacher of reading 
who was doing so much better job of teaching than any other that he 
decided to invite her to become a supervisory teacher, devoting her whole 
time to the training of the other teachers; in other words we have the 
creation of a special supervisor, and the beginning of trouble in the 
system. For the question immediately arises, To whom shall the teacher 
consider herself responsible, to the principal or to the supervisor? On 
the one hand, the supervisor is the special protégé of the superintendent 
and has his favor; on the other hand, the principal can inspect her 
work every day and his reports also have weight with the superintendent. 
If the principal and supervisor have different ideas as to how educa- 
tional work should be conducted, and the teacher sides with the super- 
visor and “gets away with it,” the principal is rapidly reduced to the 
position of a highly-paid clerk. On the other hand, if the teacher sides 
with the principal against the supervisor, we soon have open warfare in 
the system. I know of schools where it is impossible to approach the 
building from any angle without being seen. There are look-outs sta- 
tioned to watch every entrance, and the minute a supervisor appears 
anywhere in the neighborhood, word is sent to every teacher to be 
prepared. I know there is no need to tell this audience of all the schemes 
and devices used to defeat supervision. 

If the supervisor believes in flash cards, on her visit to a class- 
room, flash cards will be in evidence; but if the teacher and principal do 
not believe in flash cards, how long they will be in evidence after she 
leaves is another matter. There can be no harmonious codperation in a 
school system which has an organization represented by a divided 
authority. The connection must be broken on one side or the other. 
The connection must be between either the teacher and the principal or 
the teacher and the supervisor. 

In Detroit we have separated the department of instruction from 
that of administration. We have said that it has a specialized function 
and has no administrative responsibility whatsoever. The supervisor 
and the assistant supervisor report directly to the superintendent and 
teachers report directly to principals, principals to the superintendent. 
Thus there are no cross-lines giving rise to friction. 
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To understand what the specialized function of each group of agents 
is, it is well to study the evolutionary tendencies. You will note that 
the function of teaching has persisted unchanged from the beginning. 
When the size of the school system developed more work than the teacher 
could handle, a special! administrative officer, the principal, was created. 
Again when the growth of the system, in size, gave the principal more 
than he could do and developed the need for coérdination, a special officer 
was created, the superintendent. Still later, a new type of agent was 
created, the supervisor. It should be clear that the major duties of the 
superintendent are concerned with organization, of the principal with 
administration within the building, of the teacher with teaching, and that 
the supervisor was created to be an aid to the superintendent. She 
is a specialized agent to do his constructive thinking for him. The 
supervisor is essentially an agent charged with responsibility for 
planning. In other words, if we arrange the functions of these various 
departments in the form of a table it is possible to compare these 
functions and see the distinct quality of each. Administration is con- 
cerned primarily with the maintenance of efficiency of operation; teaching 
is concerned primarily with maintenance of efficiency of instruction; the 
distinctive function of supervision is concerned with neither one nor 
the other of these two but with a function peculiarly its own, namely, 
the improvement of efficiency of instruction. 

From my point of view the school system may be likened to a 
factory organization. In a factory there are stockholders who elect 
representatives to form the board of directors. This board of directors 
determines policies, and selects a chief executive officer to put the 
policies into effect. This executive officer creates,;-among others, two 
distinct departments: a planning department and a production depart- 
ment. In the planning department the chief engineer and his assistant 
make the plans, design the engines, etc., and submit them to the presi- 
dent. When they are approved by him, they are sent, by the president, 
not by the engineer, to the production department and production takes 
place according to the specified plans. The chief engineer has nothing 
te do with production. To be sure if the production department finds 
difficulty in interpreting his plans and blue prints, the production man- 
ager may consult the chief engineer, but the planning department has 
absolutely no responsibility for production as such. 

In similar fashion the general public corresponds to the stockholders 
of the factory. We call their representatives the board of education; the 
superintendent is their chief executive officer. He, too, has a planning 
department and a production department. The department of instruction 
is charged with the improvement of the instruction, and is essentially 
a research and planning department, while the administrative agency, 
district principals, principals, and teachers are essentially the production 
department. 

From my point of view the analogy is perfect, and this is the reason 
why, in our Detroit scheme, supervisors are relieved from all administra- 
tive responsibility. If you will study current educational literature you 
will find that the term supervision is used with a great variety of mean- 
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ings. It may serve to illustrate the confusion arising from failure to 
distinguish by distinctive terms, if we describe at some length the three 
types of work which are at present included under the general term 
supervision. 


Agent Work Real Nature 
Principal Administrative super- Direction 
vision 
Supervisor Generalized supervision Planning 
College Faculty Institutionalized super- Training 
vision 


The first type of work I shall call administrative supervision. It in- 
cludes the work done by the principal, and perhaps a better term would 
be directive supervision. In its real nature it consists of direction of the 
teacher, and its contributions are almost wholly to the operation of the 
school plan. 

A second type of supervision is the field work done by the specialized 
agents we call supervisors. The essential character of this work is 
planning and assistance to principal and teachers. 

The third level I like to call institutionalized supervision. It con- 
sists of the formal training courses carried by college faculty in normal 
schools or universities. 

Each of these will be discussed in some detail. Let us consider first 
generalized supervision by administrators and inspectorial officers. It 
seems to me there are three distinct types of work in generalized super- 
vision: facilitation, direction, and appraisal. By facilitation I mean that 
it is the duty of the principal to provide the teachers with equipment and 
supplies necessary for their work; to assign to her groups of children 
properly graded; to supply her with courses of study, methods of teach- 
ing, standards of achievement, and policies which prevail in the city. 

The principal also has need to direct the teacher in her work; that is, 
he needs to interpret the city policies in case she does not understand 
them, to supply her plans and methods of codéperation within the school 
organization; to define her duties and to coédrdinate her efforts and the 
efforts of other educational agents. All of these taken together comprise 
direction. 

The third function is appraisal. The principal needs to inspect the 
work of the teacher; to measure everything she teaches; to diagnose the 
causes of her failure, to assist her in the remedy of these failures, and 
to express his judgment in a rating which will give the superintendent 
in the central office a knowledge of the types of teaching ability which 
are operating in the schools. You will note that all these duties and 
activities are concerned primarily with the maintenance of efficiency. 

The principal is a busy man. He has a great many different kinds of 
demands upon him. In no way can it be assumed that he will be an 
expert in all these lines or that he will have time to give expert assistance 
to teachers of every type. Let us suppose that in his attempt to give 
direction to a teacher he finds that she is so poorly prepared that it will 
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take more time than he can spare to make clear to her the meaning of 
courses of study or of the methods of teaching which are set up as stand- 
ards. He would then call on the supervisory specialist and this is what 
we mean by “service on call.” Note that the supervisor does not visit the 
school to detect the teacher’s weakness, but simply reports to the 
principal with the question “What can I do for you?” The principal has 
located the weakness, diagnosed the situation, defined the type of assist- 
ance to be rendered, then turned the teacher over to the supervisor. 
Under these conditions of the supervisor working for the principal, the 
principal can tell whether or not she has rendered the service which he 
requested. This puts a heavy demand on the supervisor. She must be 
able to deliver the goods. That is, she must be a specialist in her line, 
the one person in the system who is more competent in her particular line 
than anyone else. Let us consider for a moment the function of these 
special supervisory agents. As I see it their functions are three: re- 
search, exchange, and assistance. 

By research I mean the discovery of problems in the instructional 
work of the city, the experimental solution of those problems, the 
formulation of these solutions into practical terms for the use of the 
teachers of the city, and the sale of these products to the administration. 
By exchange I mean a similar discovery of the contributions to progress 
in the work of teachers of the city. 

It is unthinkable that among five thousand teachers in a city like 
Detroit there should not be some of sufficient ability to make constructive 
contributions to the improvement of the city’s work. As a matter of fact, 
such contributions are continually being made by teachers in service, but 
they rarely receive recognition and they still more rarely find their way 
into the practice of other specialists. 

One function of the supervisory specialist would be to search for 
such contributions; to collect, organize, and formulate them for use; and 
thru inclusion in courses of study or thru publication of bulletins to 
transmit them to all the teachers of the city who are interested. 

The third form of work has already been partly described to the 
reader as “service on call.” This consists of furnishing information, 
interpreting courses of study, providing demonstration lessons, diagnos- 
ing causes of failure, giving specific training at the direction of 
principals. You will note that all of these functions are connected 
directly with the improvement of efficiency of operation. It frequently 
happens, however, that a poor teacher will require more assistance than 
a supervisor has time to render. There is need for study and intensive 
effort over quite a long period of time. In Detroit we put a substitute 
teacher in such a teacher’s place and send her into the Teachers’ College, 
where she is given directed readings, special courses, observation and 
practice teaching in the experimental school, or training in experimenta- 
tion. 

Two types of teachers are thus set free, not only the poor teachers 
in need of assistance, but the able teachers who are working on con- 
structive problems. Suppose for example that some geography teacher 
thinks of a new way of teaching some country like India. She has some 
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project which she wishes to develop. If she is an able teacher her 
principal may recommend her for a period of study and assistance. At 
Teachers’ College, she can receive the advice of the specialist on the 
college faculty; the librarians can prepare for her special reference 
material; she can have opportunity for the trying out of her ideas in 
the practice school under supervision. That is, the function of institu- 
tionalized supervision is the direct improvement of teaching ability. 

It seems to me that not sufficient attention has been given to a con- 
sideration of the conditions essential for efficient administration. These 
include first of all defined goals, policies, and standards. Then the ad- 
ministration must have adequate authority and freedom to adjust means 
to the end. He must be provided with adequate and suitable equipment 
and supplies. He must have competent assistants. He must operate in 
such a way as to secure unified and coérdinated effort. Finally there 
must be valid means of appraisal. In precisely similar fashion we can 
list the conditions essential to efficient supervision, and such listing will 
serve to make clear the difference in the two types of work. 

The first item in the list must be special aptitude for the field of 
work chosen. To this must be added proper training and a rich experi- 
ence. The next requisite is a thoro mastery of the technique of research. 
Also there must be provided the opportunity for research; freedom from 
administrative responsibility so that the supervisor may have time to 
think, time to experiment. 

Further, the special agent must have the ability to adopt the new 
to the old in practical ways which may be used by the teacher in the 
classroom. There must be a high degree of salesmanship based on evi- 
dence. Perhaps the most interesting element is the ideal of service. 
The supervisor must have that conception of her work which will enable 
her to see it in relationship to the work of all other departments, to 
recognize clearly the part for which she is responsible and the parts for 
which she is not. Personally I consider it a sign that we have taken a 
great step in advance that so many cities are coming to recognize the 
importance of the function which I have described under the general 
term of instruction and are creating special departments of instruction, 
with heads of the departments with the rank of assistant superintendents, 
coérdinate with the departments of administration, finance, etc., and mem- 
bers of the administrative cabinets. Within the department of instruc- 
tion there ought to be three distinctive types of activities: first, a divi- 
sion concerned wholly with supervision, the making of courses of study 
and the rendering of “service on call”; second, concerned with teacher 
training in all its phases; and third, carrying on the formalized instruc- 
tional research required. It requires the careful codrdination of the 
efforts of these three types of agencies really to bring about the progres- 
sive improvement of instruction. 

In this scheme the supervisors are the special agents charged with 
the solution of the city’s instruction problems. These problems may come 
to the supervisor from the principal and teachers of the city thru the 
superintendent, or they may arise from the public and come to the super- 
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visor thru the superintendent; or they may be found by the superin- 
tendent on inspectorial survey. 

Nothing in what has been said about freeing the supervisor from all 
administrative responsibility should be taken to mean that the super- 
visor is not free to visit any school building at any time on her own 
initiative. The point is that when she makes such visits she does so for 
her own information and benefit. She does not appraise the work of any 
teacher nor does she criticize any teacher. She may see that the teacher 
needs criticism and she may recognize in the work of the teacher a gen- 
eral problem which should receive her attention. 

Perhaps the best way to show how large a part research plays in 
the work of the supervisor in this scheme of organization is to give five 
or six illustrations of the research of the Detroit supervisors during the 
year 1923-24. 

One very important study was a critical appraisal of the effects of 
our program of health education. Another was the development of self- 
help methods of attacking new words in beginning reading; third, a course 
of study in the appreciation of literature with a new technique for carry- 
ing on the teaching in the classroom; a fourth was a study which had 
for its purpose the validation of mathematics and science tests; the fifth 
was the construction of tests for vocational guidance; the sixth was the 
study of the adjustment of methods of teaching to the level of intelli- 
gence of pupils taught. In my estimation the greatest benefit resulting 
from this scheme of organization is the development of what I like to 
call competitive codperation. A special illustration will serve to make 
plain my meaning. 

In the diagram [shown at the conference] D P stands for district 
principal, a principal connected with a building which he must himself 
administer, but having administrative supervision over seven or eight 
other principals and buildings. The administrative council meets every 
two weeks. Let us suppose that a supervisor has developed a new 
method of teaching spelling and that she has carefully worked out this 
method in detail, receiving the benefit of the criticism of other super- 
visors, of the members of the Teachers’ College faculty, of the research 
department, and of teachers in the experimental school assigned to her 
for the purpose. 

Let us suppose that as a result of her experimentation she has a 
body of data which proves conclusively the value of the new method. 
On a given date she would appear before the administrative council and 
present her plan offering the evidence as proof that it is better than the 
old way and recommending its adoption for the city. 

Let us suppose that one principal has a school with a membership 
largely made of Italian children and that he thinks the new method will 
not work with foreign children. When he voices his objection let us sup- 
pose that the supervisor has been wise enough to foresee this possibility 
and has prepared herself to meet this criticism by having an Italian 
school assigned to her in which to work out her new method. As soon 
as she presented the evidence that the new method did work for foreign 
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schools, what could the district principal say in reply? On the other 
hand, suppose that the supervisor had not foreseen this difficulty. She 
would be obliged to withdraw her method and ask for a foreign school 
in which to test it out. Thus administrative and supervisory forces com- 
pete in making contributions for the good of the city. 

If the supervisor has thought and planned so well that no adminis- 
trative officer can bring any valid objection to her scheme, what is there 
left for them to do but adopt it? 

The superintendent, acting as chairman of the meeting, can see that 
the proposal is considered on the basis of the merits of the evidence sub- 
mitted; in other words, can keep the scientific viewpoint uppermost and 
maintain the discussion on a fact basis. You can readily imagine what 
happens at the present time when a supervisor presents a new scheme. 
It is received in silence. At the close of the presentation someone is 
almost sure to request that the matter be referred to them for considera- 
tion for several weeks. At the next meeting of the district principals 
with the principals in his district he explains the proposed course of 
study and tells them that if they cannot find any objection to it they 
will have to take it on. The principals in turn present it to their teach- 
ers giving them the same information. This means that every teacher 
will read the proposal thru with care looking for its defects and inevitably 
seeing whatever merits it may have. 

Let us suppose that the plan is a good one and the evidence is con- 
clusive. Do you not see that at the end of this period of scrutiny and 
criticism the plan will have sold itself? When the matter is considered 
at the next meeting of the administrative council, district principals will 
report that their teachers are in favor of it and that they are ready to 
adopt it. 

On the other hand, let us suppose that the supervisor has put out 
some “half-baked” scheme and that the teachers in the field who will 
have to administer the scheme are able to point out clearly its many 
defects. The system is saved, by such criticism, from making any foolish 
changes. In other words, what this scheme does is to enlist all the 
agencies in a competition to make the utmost contribution to the prog- 
ress of instruction in the city, and the discussion on which decisions are 
based rests upon the results of scientific research. 

I wonder if you realize how vital is the position which research holds 
in any scheme of intelligent procedure. I wonder upon what basis new 
methods are adopted in your schools. There are five different ways in 
which truth is determined and methods adopted. 

The most primitive way is that which we know as inspiration. When 
a supervisor has convictions on the matter of the way spelling should be 
taught he says “I believe” or “I am convinced” or “It is my belief” or 
other phrases which merely mean that he is unwilling to consider evi- 
dences and bases his decision wholly upon conviction. We have a situa- 
tion where argument is useless. If the supervisor has authority there 
can be nothing but the dominance of conviction. 

A second common way in which methods come into schools is by a 
process of survival of the fittest. If a given method of teaching spelling 
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is adopted by this school system, then by that, and by the other, the 
time comes when it will be adopted by a great many school systems, 
simply because it is the current practice. There are styles in educational 
procedure just as there are styles in dress, and many superintendents 
and teachers are slaves to the prevailing syle. A method related to the 
adoption of current practice is a thing that I like to call imitation of 
success. If superintendent A in the next town adopts a certain method, 
gets much publicity, eventually is promoted to a larger school system at 
a bigger salary, very many of the superintendents in the surrounding 
towns will feel that his methods are worthy of imitation. 

Still another basis of adoption is the appeal to authority. If Ter- 
man or Thorndike or some other well-known man makes a pronounce- 
ment there are always many teachers and superintendents who need no 
further evidence. They accept what the specialist or the man of ability 
says without question. The best men, however, make mistakes, and there 
is only one real basis by which truth may be determined; that is, the 
appeal to nature thru inductive experimentation. 

I wish to call your attention to a condition which exists in all lines 
and which is too commonly not recognized especially by men in posi- 
tions of responsibility. 

Let us suppose that today an individual of ability is just finishing 
his period of training here at the University. He receives, of course, 
adequate training and instruction in the best ideas of the day. If, as 
we assume, he is an able student, as soon as he takes a position he 
begins to put these ideas into effect. Let us suppose that he is suc- 
cessful and that in five years he has arisen to the position of prin- 
cipal, in ten years to district principal, and say in thirty years to the 
position of superintendent. His promotion will be largely due to his 
success in standing for a certain type of work. The higher the posi- 
tion to which he is promoted the more firmly he will be wedded to his 
convictions. But meanwhile educational progress has gone forward. By 
the time he has reached the position of superintendent the point of 
educational progress will be far in advance of the instruction he re- 
ceived when he was here at the University. In other words, he is 
likely to be thirty years behind the times. For him to adopt any of 
the “fads and frills” as he calls them means for him to abandon the 
principles and policies upon which his success has been based and to 
experiment with radical and untried ideas. It is almost too much to 
expect of human nature to ask it to be open-minded to every new idea 
which comes along. If, however, the new ideas are presented with an 
abundance of evidence from adequate scientific experimentation so. that 
the superintendent may feel certain that he is not risking his success 
upon an uncertain chance he will welcome every step towards progress. 
Research thus becomes the crucial element in continued progress, and 
not until we learn to think in terms of research, not until we learn to 
carry on continuous scientific appraisal can we hope to make the schools 
as effective as we all desire them to be. 








The Evolution of Modern Educational Ideals 
By S. A. CourTis 


WE live in an age of transition. We are very conscious of the fact 
that business is changing, social conditions of living are changing, the 
home is changing, and that change is apparent in all forms of human 
activity. It is inevitable, therefore, that change should take place in 
education as well. However, we frequently fail to interpret these 
changes as we should because we do not have a proper perspective. 
What I should like to do is to present to you, in systematic sequence, 
the changes which have taken place in education from the days of old 
to the most recent development of educational theory. 

As I see it, the old education may be described by several distin- 
guishing characteristics. For instance, the goal was clearly the acquisi- 
tion of knowledge and skill; the agent was the teacher; the means used 
was subject-matter; the material acted upon was the child. Children 
were not considered in the process, except as so much inert material, 
and very many of the current practices in education are holdovers from 
the methods originally devised. 

To make plain what I mean, let us consider the typical Chinese 
school of the past generation. China for four thousand years has main- 
tained a static civilization thru its system of standardized education. 
In the old type Chinese school, children are set at the task of memo- 
rizing the classics. For seven and one-half years they learn to repeat 
by heart, in a language that they do not understand, the classic litera- 
ture of their country. Recitation consists in the child coming before 
the teacher, laying his book on the teacher’s desk and “backing” his 
book; that is, standing with his back to the book and reciting the text 
from memory. No variations of any sort or character are allowed; the 
child must repeat the classic exactly. This is the primitive method of 
education. 

Whether we turn to the American Indian or to any other savage 
tribe we shall find memorization and exact imitation the prevailing 
method of learning. 

The goal in all these cases is clearly the acquiring of standard 
knowledge and skill; the means of education is subject-matter set out 
to be learned; the agent is the teacher, and the teaching method is the 
imposition of habits by command. The pupil-teacher relationship is 
essentially an autocratic relation. It is the type of relationship which 
prevails between master and slave. The motive which actuates the child 
is fear of punishment. He is expected to obey implicitly the directions 
and commands of the teacher. Now when your school program calls 
for memorization hour after hour and day after day there is need for 
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punishment. For exact memorization is not a natural activity of chil- 
dren. . 

If you will study the schools of the Middle Ages you will see that 
the conventional sign of the schoolmaster is the bundle of switches. 
Even as late as 1845 the records of the first American survey show 
that in the average Boston school of four hundred children there were 
sixty-five floggings for a six-hour day or one every 6 minutes. Some of 
the pedagogs of the Middle Ages were also statistically inclined. Here 
is a summary of the punishments inflicted by one: 


Length of service, 51 years 


Punishments Punishments 
mee G6 BONE... esi ks LIG,BOO Bek GO GANS. occ cecccces 7,905 
Blows with cane......... 911,527 Wear dunce cap.......... 3,001 
Blows with rule.......... Bee ~ aS ca vad cosecves 3,000 
Blows with rod.......... 125,010 Kneel on peas........... 777 


Such figures furnish an impressive proof of the basis on which primi- 
tive education was conducted. The time came, however, when the 
growth of the democratic spirit in society would no longer tolerate the 
use of the corporal punishment with its children. The poor school- 
masters were inevitably driven to find other methods of teaching. 

About the year 1700 a change gradually came into our schools. The 
course was still the acquiring of knowledge and skill; the means was 
still subject-matter set out to be learned; the agent was still the teacher, 
but teaching required preparation; the efforts of the teacher were di- 
rected toward pre-digesting the subject-matter and getting it in shape 
for the pupil to learn it. The method was largely based upon per- 
suasion. The pupil-teacher relationship was still autocratic, but was 
modified slightly, say from master and slave to master and servant. 
The learning activity was still memorization, but the motive, instead of 
being fear of corporal punishment, was fear of sarcasm or some of the 
many forms of social punishment. 

The new education of that day, however, made one important con- 
tribution to educational progress. It emphasized the need for the train- 
ing of teachers. Normal training dates from this period, also the de- 
velopment of methods of preparation. There are many in this audience 
who have been trained in the five formal steps required in the Herbartian 
philosophy. 

A second contribution was the emphasis upon study of clHildren. 
Previous to this period children had not been considered, but if you are 
attempting to find a way to compel an individual to do something by 
persuasion, you must, of necessity, begin to study his interests. Ac- 
cordingly, a very little later the new education put the emphasis upon 
motivation. The goal was still acquisition of knowledge and skill, but 
the subject-matter to be learned was organized in such a manner that 
it would interest the children; that is, related topics were joined to- 
gether around some center of interest. The teacher, as the agent, bent 
her efforts towards stimulating interest. The method was giving of 
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directions; the emphasis was upon achievement, and the pupil-teacher 
relationship took on the character of our relations to a specialist. Pupil 
activity was regarded as following directions and learning by doing. 
There was much emphasis upon drill, but there was real interest on 
the part of the children in what was learned and a very radical change 
in methods of teaching and in the form of classroom procedure. For 
instance, the title of a reader for children in London in 1809 is The 
Invited Alphabet, or The Remarks of A to B, Containing Proposals for 
the Amusement and Instruction of Children. The author frankly says 
in his Preface, “The design of the little publication here presented to 
the view of the children is to allure them to the vestibule of learning.” 
On each page of this primer are shown five different types of alphabet. 
The children learn to recognize each of the five types of letters, then 
to combine the letters into syllables and the syllables into words, and 
last of all to read. Motivation is essentially sugar-coating the educa- 
tional pill. It has one very important value, however. It led teachers 
to study children more closely. They found that children were inter- 
ested in any form of activity, and many practical exercises in ways and 
measures gradually found their way into the schools. They also found 
that children were social beings. They were most interested in activi- 
ties which they carried on as a group and they were interested in the 
activities of the world about them. 

By and by the emphasis shifted from subject-matter, as it had been 
in the older days, to the children themselves; that is, the goal of edu- 
cation, as stated during this period, was the awakening of social con- 
sciousness. Aims were stated in terms of citizenship. The means used 
to achieve these aims was the socialization of school activities. The 
agent was no longer taken as the teacher but as teachers and children, 
and the method was participation in group activities. Learning became 
more nearly functional, and the pupil-teacher relationship changed to 
one which recognized the leadership of the teacher as a person of com- 
petence. The motive could be characterized as creative expression. We 
began to hear about school gardens, school papers, self-government 
clubs, and the rapid development of all the extra-curricular activities 
which are common in our best school today. 

More than this, the actual procedure in the traditional subjects was 
put on an activities basis. The making of a school garden as a project 
can no longer be conducted on the basis of recitation of a memorized 
formula, and so by degrees the way was paved for scientific method. 
By this means came a process of learning thru scientific organization 
of subject-matter in terms of children’s natures. The goal is integra- 
tion of personality, and this is interpreted to mean the development of 
the power to form worthy purposes, of power to achieve the right things 
in the right spirit. 

The educational process consists of participation in selected life 
activities, both social and individual. The agents charged with respon- 
sibility for education are the children themselves. The teacher is a part 
of the process coming in to help the children. The teaching method 
consists in providing situations which will give the children experience 
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in forming purposes, in making plans, in carrying out plans, in judging 
of thei success, and in making generalizations for the control of future 
conduct. All idea of formal learning is abandoned. Learning takes 
place incidentally from experience and is functional in character. The 
pupil-teacher relationship is democratic, friendly guidance, and the mo- 
tive is the pursuit of happiness. 

Now there are numbers in this country who have carried the evo- 
lution still farther. I like to characterize their philosophy as the natural 
method. They claim that education should be evoluted as in the state 
of nature. The goal at which they aim is the freest possible self- 
expression. The only educational means they recognize is participa- 
tion in undirected life activities. They make the children the social 
agents, and the teaching method which they advocate is to give the 
child freedom to evolve. They do not accept any form of indoctrina- 
tion. The pupil-teacher relationship becomes complete dominance of the 
children. The motive is the pursuit of happiness.. 

I, myself, believe that these persons have gone too far in their 
evolution. They have thrown away all the advantage of the past life 
of the race, and yet there is something to be said for their ideas. For 
the method they advocate is the method used by God himself. He puts 
us in situations and leaves us to form our own purposes and does not 
interfere in any way in the carrying out of our plans. There can be 
no doubt that this is a most effective method. The only trouble is that 
it is tremendously costly in time and effort. We have no guarantee 
that it will not take the new generation as long to evolve as it has 
taken the human race from the beginning of civilization, and, some of 
us, therefore, wish to combine the ideals of this extreme form of 
thought with the practical advantages which come from making use of 
the accumulated wisdom of the race. 

We attempt to short-circuit the evolutionary process by transmit- 
ting to the children the wisdom that has accumulated during the past 
ages but we appreciate to the fullest measure the need for doing so 
by methods which will leave the child free to carry the evolutionary 
process forward. 

This, then, is the great problem of method: how to achieve the 
fullest possible development of the child, how to stimulate the fullest 
creative expression and yet at the same time put in the child’s hands 
the accumulated experiences of the race without thereby compelling him 
to adopt the patterns of behavior which each age has proved inadequate 
for the demands of progress. 

By way of summary, therefore, let me call your attention to the 
fact that the six methods we have been discussing may be grouped in 
two classes as follows: Objectives as related to method— 


1. Acquiring knowledge and skill 4. Socialized instruction 
2. Acquiring knowledge and skill 5. Integration of personality 


3. Acquiring knowledge and skill 6. Freest realization 


3 R’s, Readin’, writin’, and ’rith- 3 P’s, Purpose, power, personality 
metic 
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It cannot be too much emphasized that the new education works for 
very different goals from the old; that the acquisition of knowledge 
and skill holds a very minor place in the new objective. The people 
who believe in the new education of the present day stress the fact that 
when a test in any subject is given to a group of successful men and 
women like those present the scores made reveal the fact that no gen- 
eral items of information are equally valuable to all people. Each of 
us selects very carefully in terms of his own life interests and pur- 
poses the elements of knowledge which he remembers. It is not knowl- 
edge which is important but purpose and power and personality. I can 
almost hear some good old-fashioned teacher in this audience say, 
“What in the world does he mean by purpose? I can understand read- 
ing, writing, and arithmetic, but not purpose.” Well, let me give you 
a specific illustration. Note the following example taken from an arith- 
metic: “A grocer had two large baskets, one containing 46 apples and 
the other 38 apples. He put all the apples from the large baskets into 
7 small ones, putting an equal number of apples in each small basket. 
How many apples did he put into each small basket?” 








KKEREAKAKKK KK KKK * 
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1. In the small squares below make as many crosses as there are stars in the 
two large rectangles above, placing an equal number of crosses in each small square. 
































This same problem, however, can be presented as a situation. Note 
that in the figure the large baskets have been replaced by rectangles, 
the amount by stars, the small baskets by squares, and the question 
by the assignment, “In the small squares below make as many crosses 
as there are stars in the two large rectangles above, making an equal 
number of crosses in each small square.” If there ever was a “time 
when a fellow needs a friend” it is when he meets a problem like that. 
How are you going to tell whether you add, subtract, multiply, or 
divide if no question is asked? 

When a boy graduates from our eighth grade and takes a position 
in a grocery store his employer does not follow him around and formu- 
late his questions for him. He turns over complete situations to him, 
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giving him assignments within that situation, and the child must have 
power te see the problem involved, to formulate it for himself, to make 
a plan for its solution, to determine whether he has solved it correctly, 
and to profit by his experiences. To the degree that he becomes able to 
do these things he becomes a successful man. 

How do you, yourselves, who are teachers, know how far you are 
giving the children in your classes opportunity to purpose and plan 
and judge and generalize for themselves? It is easy to measure the 
ability of children with respect to the arithmetic problem I have just 
shown you. For instance, in a certain eighth grade class consisting of 
52 members, 94 per cent of the answers to the verbal problem were 
correct. When the same problem was given to 125 teachers, 95 per 
cent of their answers were correct; that is, the children could solve 
the problem just as well as the teachers, but not so when the problem 
was presented in the other situation. The number of correct answers 
from the children fell to 42 per cent, while those of the teachers fell 
to but 88 per cent. The difference indicates the missing element in 
education; the element which the methods advocated by those who be- 
lieve in the new education of the present day will supply. And please 
note that not all of the 42 per cent of correct responses are to be at- 
tributed to the school. Many of the children who are able to deal with 
situations successfully received the essential part of their development 
of power from activities outside of school, such as selling papers, or 
working in a store after school hours, etc. 

I have answered your question. Now let me ask you a question, 
In the human control of a natural process, what can and what cannot 
be controlled? Suppose, for instance, the farmer becomes dissatisfied 
with the yield of corn from his farm. What is it possible for him to 
do to increase the value of his farming operations? He can determine 
the essential elements related to the growing of corn, but can he change 
those essentials? He can determine the most favorable conditions for 
growing corn, how much water, what kind of soil, what temperature, 
etc., are best, but can he change those conditions? He can determine 
the most favorable sequence of activities, when to plant, how deep to 
cultivate, when to harvest, etc., but can he modify that natural se- 
quence? He can determine the natural production, how much starch, 
how much sugar the corn contains, but can he change those products? 
He can select, organize, formulate, but can he create something new? 
You know very well that success will attend his efforts only as he con- 
forms to natural law; that there is no possibility of his altering natural 
law, no matter how wise or how much scientific investigation he car- 
ries on. In other words, if we wish to make our education of value, 
the proper way to go about it is to study the relation of education to 
life processes. 

Let me give you a natural instance of learning. In a certain town 
three or four parents, by chance, gave their boys rifles for Christmas. 
These boys got together and organized a shooting club. One of the 
boys living in the neighborhood of the members of this club went to’ 
his mother and asked her to give him a rifle, but his mother replied: 
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“Certainly not! In the first place, you are not old enough to have a 
rifle. I would be afraid that you would shoot yourself or somebody 
else. In the second place, I don’t believe in war, so don’t let me hear 
anything more about this silly notion.” The boy, being a wise boy, did 
not argue the matter, but faded into the landscape and disappeared. 

That night, however, when his father came home the boy met him 
about two blocks away and told him about the club and the good times 
the boys were having. He asked his father to give him a rifle. How- 
ever, the father was as wise as the boy. He said, “What did your 
mother say?” and the boy had to admit that his mother had said “No.” 
“Well,” his father replied, “Doesn’t that settle it?” But the boy said, 
“When you were a boy did you not have a rifle?” and his father had 
to admit that he did. “Didn’t you like to belong to all the clubs that 
the boys had?” and again his father had to admit that he did. “Well 
run along, sonny,” said his father, “I will see what I can do for you.” 

That night they had a family counsel. The father did his best for 
the boy, but the family was too much for him. The mother and the 
auntie and the grandfather were quite sure that it was not right for 
a boy to be given a rifle. 

So the next morning when the boy came to ask about it, his father 
had to tell him that he was sorry he could not give him a rifle. The 
boy’s face fell and he jammed his fists down into his pockets and said, 
“Gee! That’s tough.” Something in the boy’s manner and in his voice 
touched his father’s heart and he had a great inspiration. Being a 
true American he conceived the idea of “passing the buck” and stand- 
ing by both sides. 

He said to the boy: “I am sorry I cannot give you the rifle, but 
I will tell you what I will do. If you have spunk enough to earn the 
money to buy the rifle I will protect you in the possession of it.” You 
see he thought the boy could not earn the money and so he could retain 
the boy’s good will and yet stand in with the family. 

But the boy was a true American boy also. He said, “Sure, I can 
earn the money,” and went off smiling. 

He began to run errands, do odd jobs, and save his money. And 
then a very wonderful thing happened. In school this boy does not 
stand very high in English composition and letter-writing, but in less 
than a week he had written to every firm in the United States that sells 
rifles, and in two weeks after the catalogues were received in reply he 
could tell you how much each type of rifle cost, how far it would shoot, 
what kind of ammunition it used, all of which he learned without con- 
scious effort, altho in school memorization of a single rule in grammar 
would be a cause of complaint for a week. 

When he had saved enough money and purchased the rifle, a still 
more wonderful thing happened. He immediately sought out the young 
lieutenant home from France and pestered the life out of the young 
man to drill him in shooting. The boy was not satisfied merely to shoot 
the rifle. He had ambition to become an expert. He wanted to handle 
the rifle according to army regulations and he demanded much more 
training, much greater drill than even the ex-army officer thought neces- 
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sary. Today all over this country and in other countries thruout the 
world wherever the new education has made an impression, there are 
boys and girls who are carrying on activities under the drive of their 
own initiative, who are pestering teachers for assistance in the writing, 
memorizing, and reading on exactly the same basis that this boy pes- 
tered the young lieutenant. 

In other words, we have not only been working for the wrong ob- 
ject in education, but we have made a wrong analysis of the teacher’s 
work. In terms of the new education there are only certain things that 
a teacher can do. The first of these things is the stimulation of pur- 
pose thru the selection and presentation of situations. Further, if this 
work is to be done effectively the child’s capacity and previous develop- 
ment must be carefully determined, and subject-matter must be selected 
in terms of the nature of each individual child. 

It is easy to get a child to purpose in any situation, but the pur- 
poses he forms are not all worthy purposes. The teacher’s task is not 
complete until sufficient guidance has been given to raise the level of 
the child’s purposes to a worthy level for him. But here again it is 
the child’s standards of value which determine what is worthy and not 
the teacher’s. 

Once a child has formed a purpose it makes him self-active. 

The third phase of a teacher’s work, therefore, is the assistance 
and encouragement of the child in the achievement of his purpose. But 
here again the assistance offered must be in terms of the child’s con- 
sciousness of need. When the child has attained his object and has 
completed the work, there is a fourth phase of the teacher’s work that 
becomes possible, namely the interpretation of experience. The teacher 
has had a wider series of experiences than the child and if she bases 
her interpretation upon the conclusions reached by the child, she may 
share the benefits of her experience. 

The four phases of a teacher’s work then are: stimulation, guid- 
ance, assistance, and interpretation. But the center of emphasis is the 
child and not the subject-matter. 

Let me present you with four standards to determine the degree 
to which your teaching conforms to this ideal. 

The first test is brought out by the question, Who sets the lesson 
which you teach? If you are forced to answer, “the teacher,” will you 
please explain how the child is going to develop any power of self- 
direction? Under the scheme of teaching proposed in the new educa- 
tion the children are taken into the partnership and given a share in 
setting the lessons for the distinct purpose of providing them with ex- 
periences in purposing and planning. 

The second question is, Who marks the achievement? Again if 
you answer, “the teacher,” will you please explain when the child is 
going to get training in appraisal which is so essential in life? How 
can you expect an individual to be able to criticize his own activities 
if he never has an opportunity in which to exercise judgment, if he is 
never given a chance to criticize? Appraisal is one of the essential 
elements of success. 
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The third question is, Who keeps the order? If the teacher rules 
the classroom as a czar rules his kingdom, are the children being given 
adequate training to fit them for life in a democratic community? 
Please explain how behavior in response to orders develops that type 
of freedom under law which is the pride of our American idealism. 

The fourth question is, Who helps the failures? Do the children 
help each other? The purpose of this conference, as I understand it, 
is to enable the different leaders in education in the state to get to- 
gether and share their experiences, to help each other find the answers 
to their various problems. To the degree that the educational agents 
of the state can pool their brains and coéperate in the solution of their 
common problems, this state will prosper. If children are really inter- 
ested in their achievement in the classroom, will they not receive valu- 
able training in codperation, if they are allowed, yes urged, to help 
others ? 

From my position here on the platform I can see reaction, from 
certain auditors, of a type with which I am familiar. I can almost 
hear some good teacher, who has been successful under the old meth- 
ods, say to her companion “How absurd! What sort of nonsense is 
this that he is preaching? How can a child set the lesson when he 
knows nothing of the subject?” Yet consider for a moment what has 
happened in this country during the last few years. 

I remember a day not so very many years ago when my boy came 
to me in great excitement one evening and said, “Daddy, here is an 
article in the paper which tells how you can wind a coil of wire, put 
up an aerial, and make a wireless receiving set for $7. If you will 
supply the money I will do the work, and we will have a wireless set 
of our own.” I looked at the article and sure enough it did sound prac- 
tical. So I staked the boy to the $7 required. The next night when 
we had all the material in our possession, we went down into the cellar, 
wound a very crude coil, and made the necessary adjustments according 
to instructions. Sure enough, the concert did come through. Not so 
very long after that my boy came to me again and this time it was, 
“Daddy, here is an article in the paper telling how, if you add a tube 
and a condenser to the coil of wire, you can get a station from out of 
the city.” And it is perfectly surprising how many $7 that boy can 
spend on radio. 

All over this country, from one end of it to the other, boys and 
girls, even in the grades, have been setting themselves mysterious, inter- 
esting tasks in construction, and becoming expert operators; doing 
things as amateurs that even some of the professionals have not been 
able to do, all without one word of assistance from the school. Is not 
this proof that a child can set his own lessons? That a child can learn 
under the drive of his own initiative? 

You know what would happen if we put a course in radio in the 
school at the eighth grade level. First, we would teach the child the 
names of all the binding posts and the number of contact points, the 
technical terms for this and that. We would not consider him compe- 
tent to try to receive a message until he had passed thru six or eight 
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months of training. In our home, however, the goal was not learning 
but achievement, and we reached some sort of satisfactory achievement 
the very first night. 

The new education would reconstruct the curriculum in terms of 
activities leading to such achievements regarded as desirable by the 
children themselves. It would completely discard direct subject-matter 
teaching. It would subordinate subject-matter to children. 

Now please do not mistake the real significance of the change in 
emphasis from the old education to the new. We were told that this 
last war was a war between autocracy and democracy to determine 
which theory of government should prevail. I don’t know what the 
words autocracy and democracy mean to you, but to me autocracy means 
irresponsible authority. At the top we have a person who rules by 
divine right; that is, he is not responsible to anybody except a higher 
power. Under him there is usually a noble class that have certain 
rights, and under the nobility a privileged class that has a few rights, 
and under the privileged class a laboring class who have no rights at 
all except to do as they are told. In a democracy each individual is 
regarded as a ‘sovereign personality. These sovereign personalities com- 
bine for the achievement of common goals. They elect one of their 
number as their executive officer and they delegate a portion of their 
power to him, but they hold him responsible for the use of that power. 

During the war we found that a person who receives this delegated 
power is stronger than the man who rules by absolute power. Now let 
me ask you about the type of training needed by citizens who are going 
to live under these two forms of government. 

Do you not see that in an autocracy the common man needs only 
two types of training? He must be taught to give unquestioned obedi- 
ence to commands, and there must be definite and adequate technical 
skill. But in a democracy the first need is to bind the different indi- 
viduals into a common group thru some recognition of the dependency 
of each man on the others. There is need for the development of the 
ideal of service. This is the master problem. Once this is achieved, 
success is assured, provided each individual has adequately developed 
powers of self-direction, self-appraisal, self-control, and adequate com- 
mand of the technique of codperation in the achievement of social pur- 
poses. 

Another important aspect of the change which the new education 
is bringing about is that the new procedure ministers to the complete 
nature of the child while the old education touched only one phase of 
his life, the intellectual. You will find that on the lowest levels, psy- 
chology consists simply of sensations and motor responses. On the 
higher levels it involves feelings and consciousness of desires as well. 
On the highest levels it involves thinking and purpose in addition to all 
that has gone on in the lower levels. Our emotions are the sources of 
standards of value. One of the most important aspects of education is 
that which integrates all the elements listed above and builds them 
into a unified control. Control promises to be the key word of the fu- 
ture and control in the last analysis is clearly associated with charac- 
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ter. The primacy of character in education is coming to be recognized 
by all. You see man comes into this world organized as a biological 
being. As he grows more intelligent, he comes to recognize his rela- 
tions to other men. He becomes transformed into a sociological being. 
If the man does not acquire from his educational experience some form 
of organized control, he has little chance for success, but if his educa- 
tional experience led him to adopt worthy life purposes and if intelli- 
gence, emotion, and all the other conflicting elements are brought in 
the line and become assistants, he is “born again” into a sociological 
being, and becomes a new creature. 

By way of conclusion let me present a specific illustration of the 
principle I have been discussing. I have chosen for this purpose some 
material we have developed which is commonly called a new method of 
teaching reading. I, myself, do not regard it as such. In fact, the 
first thing we say to a new teacher who is going to be trained to use 
the method is that “If we find you teaching reading directly we will rate 
you as a failure.” Her natural response is, “Well, if I am not to teach 
reading what am I to teach?” We say to her, “You are to teach the 
children to help themselves, to make the children independent of you. 
Your success depends upon the degree to which you can make the chil- 
dren competent to get along without you. Never mind the reading 
results. If you do the other work as you should the reading will take 
care of itself.” 

For instance, the teacher has on her desk a series of sheets which 
are clearly incomplete pictures. She also has sheets of cut-outs like 
the Sunday supplement cut-outs. She points to the paste, scissors, and 
various other available things on her desk. She asks how many of 
the children would like to cut, color, and paste, and make a picture from 
this material. Now we know by experimental determination that cut- 
ting, coloring, pasting, and making pictures has an attraction for every 
normal child who is six years old mentally. 

The situation presented by the teachers is intrinsically stimulating, 
and the children readily adopt the purpose of making the picture. No- 
tice that the child’s purpose is not to learn to read. Then the teacher 
says, “I will let you take this material on one condition; that is, that 
you make the picture according to directions,” and she gives each child 
a book of printed directions. To help the child read the directions the 
teacher gives him a dictionary in which each word is represented by a 
picture and she shows the child how to use the dictionary for himself. 
If he wishes to make the picture he has to puzzle out from the diction- 
ary the meaning of the characters. When he has his picture completed, 
he takes it to the teacher and compares it with the picture she has 
made. He can then tell for himself whether or not he has been suc- 
cessful. If he has, the teacher gives him a small sheet of paper which 
he can put into a folder called “My Story Book.” On this sheet of paper 
is a small duplicate of the large picture he has made and underneath 
it a story which he reads. The child does not consider that he is doing 
something for the teacher; it seems that the teacher is doing some- 
thing for him. He speaks of “my story” and he will read the story 
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over and over and over again to anyone who will listen to him. Thus 
from the very beginning he uses reading as you and I do, as a means 
to an end. He forms purposes before he acquires skill. 

The teacher’s work consists in training the child to help himself. 
This figure [shown at the Conference] represents the first lesson in 
which the teacher attempts to set the children free from her control. 
You will see gathered around her all those children who believe they 
are capable of making the picture. They are proving to her that they 
are capable by reading. The children at the table are the children who 
say in terms of their own judgment that they are not capable of fol- 
lowing the printed direction. 

In this next picture you will see the children in the first group at 
work under their own direction at the tables, cutting, pasting, and fol- 
lowing direction. Each is working as an individual, and from this time 
on each child goes at his own rate working in his own way and taking 
complete charge of his own education. Of course he cannot help but 
learn to read, but to him the activity is not learning reading but building 
pictures. 

The next picture [shown at the Conference] is of a class which has 
partially achieved the result. In the first three rows of seats you will 
see children who are working under their own direction. Each one 
is on a different lesson. If any child needs assistance he raises his 
hand, and some of the other children come and help him. The remain- 
ing rows of which the teacher has charge are made up of children who 
have not yet achieved independence. The teacher’s efforts are not 
directed toward teaching them to read but toward teaching them in- 
dependence. 

Now what about the results? Careful comparison shows that in the 
hands of teachers who have caught the spirit of the new education chil- 
dren taught by this method learn slowly at first and very rapidly towards 
the end of the semester. In the final tests they are able to achieve 
almost the second standards in the Haggerty, Oglesby, and other reading 
tests. In other words, in these classes, where no effort is made to teach 
reading as such, the children have accomplished in one semester as 
much as the conventional child does in two years. 

Now what about the use of this thruout the city schools? The 
results seem to me to prove clearly that the new education involves a 
distinct change of viewpoint. For when this method was put into four 
schools which volunteered to try it, and the achievement in reading 
in these schools was compared with the conventional school, it was 
found that if anything the conventional schools were slightly ahead. 
Repetition of the controlled experiment, in four schools proved, however, 
that with the new method the children in the first grade were able to 
reach the standard of the children in the second grade of the conven- 
tional schools. 

Our figures show that only about one-quarter of the teachers were 
able at once to adopt all the ideas of the new education and use this 
material in ways which enable them to realize its value to the pupil. 
We have had to organize special methods of teacher training to shift 
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the point of emphasis of these teachers from subject-matter to the 
children. This is the process which is gradually taking place now 
thruout the world. 

In other words, the new education turns the ideas of the old educa- 
tion upside down. It expresses the goal not as acquisition of knowl- 
edge and skill but as the integration of personality. It recognizes the 
child as the center of the educational process and says that the teacher’s 
chief function is to assist the child, not to control. It says that the 
means employed is the forming and achieving of purposes; that the 
material used must be appropriate to the nature of the child. In other 
words, the new education defines education as the process of helping 
children to help themselves, (1) to form ever worth-while purposes, 
(2) to achieve their purposes ever more efficiently, and (3) to effect an 
ever more harmonious organization of their emotions. It emphasizes 
incidental learning and above all else it recognizes the sovereignty 
of personality. Have you ever heard this one, “That is just what I have 
been doing for the last twenty years”? If so, you can be sure that 
the person has not understood the new education, for today we have a 
more adequate understanding of the scientific information about chil- 
dren and of the whole educational process than has ever been possible be- 
fore. No one operating twenty years ago could possibly have conceived 
the idea of the new education so I appeal to you to join with the rest 
of us in the scientific study of children, and in the adaptation of the 
new educational methods to the child. 











The Influence of Nature and Nurture upon 
Test Scores 


By S. A. CourtTis 


ONE of the achievements of our century of which we are justly 
proud is the development of a science of education. I am afraid, how- 
ever, that some persons are too optimistic in their estimates of the 
degree to which the new science has developed. In my judgment they 
forget that time is a very important factor in such development. If 
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Fic. 1. The figure shows a time scale for two periods of transition, 

the first from astrology to astronomy, the second from alchemy to chem- 
istry, each approximately 150 years. Men are given above the time 
scale and events below. These periods are characterized by the inven- 


tion and perfection of measuring instruments and the rapid accumula- 
tion of data. 


we consider the history of other sciences, we find that it has required 
on the average approximately a century and a half to develop from 
the state of formulation of a new approach to an old problem to the 
state of formulation of exact law. 

For instance, in astrology, a very old field of human thought, the 
new viewpoint was given to the world by Copernicus about 1530 (Figure 
1). To change from the “common sense” explanation of the earth as the 
center about which the other heavenly bodies revolve to the seemingly 
absurd conception of the earth as merely one of a family of planets 
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whirling at high speed around the sun as a center, at the same time 
turning rapidly on their own axes, calls for a transformation in thought 
so profound that it is no wonder that the theory did not meet with 
instantaneous acceptance. What it did do was to stimulate the con- 
struction of measuring instruments of precision and the making of 
extended observations. Kepler’s fundamental generalizations, based on 
Tycho Brahe’s careful observations, were given to the world almost 
exactly three generations after the publication of the theory of 
Copernicus. Or if we count from the beginning of the exact measure- 
ments of Tycho Brahe to the resultant generalization by Newton in re- 
gard to motion and gravitation, a generalization which has stood un- 
challenged until our own generation, the period is again almost a perfect 
century. 

The transition stage from alchemy to chemistry was of similar 
length. From the work of Boyle—the “skeptical chemist,” to whom 
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Fic. 2. The development of education as a science is shown on a 
basis comparable with that of the two previous figures. 


more than to any other one man we owe the change from subjective in- 
terpretation of “common sense” observations to objective measurement of 
mass by means of the balance and the development of modern methods 
of experimentation—to the work of that brilliant group of men whose 
labors changed the concept of elements from fire, water, earth, and air to 
the conception of elements we have today, was approximately 115 years. 
Note that even after the new concept had been firmly established it 
required a whole generation to determine the fundamental laws of 
definite and multiple proportions, and to develop the atomic theory. 

If now we turn to education, we find that the beginnings of the 
scientific study of human behavior were made about 1875. Galton in 
England, Wundt in Germany, and many others by their labors trans- 
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formed psychology from a speculative to an experimental basis. Cattell, 
Rice, Binet, all represent stages in the development of methods and in- 
struments of measurements, but the first true measuring instrument for 
an educational product was not given to the world until 1910. I refer, 
of course, to the handwriting scale developed by Professor Thorndike. 

So far, therefore, we in education are running true to form as far 
as the general cycle of development is concerned, altho at an accelerated 
rate. This acceleration is probably due to our better facilities for com- 
munication and exchange as well as to the very large increase in the 
number of adequately trained workers. It thus becomes possible to 
orient ourselves in the process of development and to realize that educa- 
tion is in the stage of development of measuring instruments and the 
accumulation of data. Also it is clear that the next important forward 
step will be the isolation of fundamental factors, the development of new 
concepts of elements, and the working out of the laws of relationship 
between these new elements. Clearly also the day upon which this for- 
ward step will be taken lies not very far ahead. Already Spearman 
and others in England, Thorndike at Columbia, Dearborn at Harvard, 
Freeman at Chicago, Terman and Kelley at Stanford, I at Michigan, 
and many others are hard at work on the problem, and our efforts are 
meeting with various degrees of success. I venture to prophesy that 
before the completion of the present generation, say before 1945, our 
present difficulties will have been resolved, the new concepts will have 
been solidly established, and we shall have entered upon the final stage 
of development, the experimental determination of fundamental laws. 

Accordingly, this afternoon I propose to discuss some of the recent 
develcpments along the lines and to present certain ideas in regard to 
the influence of nature and nurture upon test scores. 

There are really only two basic problems in education. We are 
trying to find the answers to the questions: (1) Why do children differ? 
and (2) Why do they succeed? There are also two methods of attack. 
One of these is the method followed almost exclusively in the past. It 
is the method of averaging. Data are massed and averaged, correlated, 
etc., in the hope of discovering general tendencies. It is a method based 
upon assumptions, statistical and otherwise, which may or may not be 
justified. At least no experimental proof of their validity is ever offered. 
The methods are logically perfect, of course, but to the degree that a 
logically perfect tool does not fit a given situation, the results secured 
by the use of it are misleading. Today in America we have, on the one 
hand, a rapidly developing statistical complex of partial and multiple 
correlation, coefficients of attenuation, contingency, idiosyncrasy, vari- 
ance, and goodness only knows what all besides, all very good in their 
places, but all based upon pure hypothesis unsupported by experimental 
data. On the other hand, we have a growing distrust by practical school 
men of the conclusions reached by methods which they are not competent 
to follow, a growing conviction that, after all, education has gotten 
along for many years very well without science, and perhaps the con- 
tributions science can make have been overestimated. Perhaps the most 
damning straw showing which way the wind is blowing is the summary 
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of the products of the statistical method. “Not a single law,” wrote 
James of psychology in 1892, “not a single proposition from which any 
consequence can causably be deduced.” Spearman in 1925 has applied 
James’s statement to education, and even strengthened them with others 
of his own. 

The other method is the analytical method. In place of massing 
data, it separates data into homogeneous classes. It looks for elemental 
unitary influences, and, more than all else, it tries to observe rigidly 
the law of the single variable which is the basic law of science. It 
not only believes that “an effect may properly be ascribed to a given 
factor as cause only when all other factors have been held constant, or 
their effects accounted for by correction.” This school of thought not 
only has convictions about the law of the single variable; it acts on its 
convictions. Seashore’s study of musical ability is the outstanding ex- 
ample of the analytical method. 

What the final outcome will be it is too soon to tell. Neither school 
of thought has scored a signal victory as yet. Both have made progress. 
The truth will probably be found by a happy combination of the two. 
Certainly our educational problems are so complex that no serious stu- 
dent of education can afford to ignore the analytical potentialities of 
the statistical method. On the other hand, it is equally certain one 
cannot safely accept or reject the generalizations solely because they 
have been reached by men of great ability using statistical methods of 
such great complexity that one cannot himself tell whether they are 
valid or not. It is better, however, to be too skeptical than too gullible. 
All of us need to pay far more attention than we do to the direct 
experimental validation of all generalizations, however those generaliza- 
tions may have been obtained. 

In a large way we know today what the basic factors are. One 
of them is nature,—heredity—inborn capacity. Kelley has recently given 
us a very helpful definition of what we mean by nature. Under this 
term, he says, are to be included all “traits, making for individual 
differences, which do not change with age.” The fact of individual 
differences, in achievement and in rate of growth, is the outstanding 
contribution of psychology to education. Children differ, and some of 
the causes of difference exist from birth, even before birth. Moreover, 
in some cases they can be traced from parent to child, from one genera- 
tion to another. Whenever we hold all the environmental influences 
constant, differences in individuals must be caused by differences in the 
native factor. Illustrations of effects which we ascribe to nature are 
known to all of you. For instance, children differ physically in build 
from birth, and these differences are inherited. Similarly, children differ 
fundamentally in what we have come to call intelligence, and these 
differences condition the response the children make to training. The 
individual who has doubts on these matters can readily determine for 
himself, experimentally, the facts in the situation. All that it is neces- 
sary to do is to give a group of children carefully controlled uniform 
training and note the results. For instance, by appropriate tests five 
words were discovered which no child in a certain second grade class 
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could spell. They were: picture, circus, pencil, umbrella, knife. A 
method of teaching by playing a game was adopted, a method of so 
unusual a character that it was almost certain none of the children could 
play the game or study the words except during the study period in 
school. At the end of the first day two children had learned to spell 
all five words perfectly, but at the end of the sixteenth day only twenty- 
five out of the thirty-eight had mastered all five words perfectly. Of 
course such an experiment does not prove that children differ because 
of differences in nature. Perhaps all the differences could be explained 
by differences in age, home influences, school training, personal tastes, 
etc., but much evidence is available that even in fundamental things 
like the age at which teeth appear, the time of ossification of the wrist 
bones, etc., natural differences in children occur. What the spelling 
experiment does prove is that children differ in their ability to profit 
by uniform experience, and that these differences need to be explained. 

Another important concept is that of nurture. Kelley defines nur- 
ture in terms of “influences uncorrelated with nature, making for in- 
dividual differences, changing with the time through which they act.” 
This definition is good, but it is too inclusive for me. I like to break 
nurture up into three divisions. The first series of factors I group under 
the term maturity. They comprise the developmental effects of physical, 
mental, and emotional growth as such, without regard to the effect of 
training. In other words, changes take place in a child as a result of 
living, eating, sleeping, working, playing. Each child, under our general 
social conditions, has his own rate of maturation which in some way 
is a function of his nature. 

But in addition to the factors just discussed which apply to all chil- 
dren without exception, there are other factors, such as the social in- 
fluences or the unorganized training given by home, church, street, and 
civilization in general, and still others such as the organized and con- 
trolled experiences which comprise school training. All of these are 
included in Kelley’s definition, but some of our most important problems 
center around the questions: (1) How much of a child’s change in score 
from year to year is caused by just plain development or maturity? 
(2) How much of a child’s score is determined by the type of home or 
neighborhood from which he comes? (3) How much of a child’s achieve- 
ment is to be credited specifically to the direct efforts of the school? 
Evidently, the answer to such questions can be found by keeping nature 
constant, and allowing nurture to vary. For instance, if we subject 
identical twins to identical practice they respond in the same way, while 
individuals known to differ respond in different ways. 

Unfortunately, the attempt to determine the relative influence of 
nature and nurture leads to many.misunderstandings. Our profession at 
present is divided into three camps: (1) the hereditarians, or deter- 
minists, who believe nature is the controlling factor so that life for all 
practical purposes is predetermined at birth; that there is nothing the 
school can do but to sit by and watch the drama play itself out to the 
tragic end; (2) the environmentalists, who shut their eyes to all evidence 
and believe that the teacher is all-powerful to make out of each child 
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what she will; and (3) the unitarians, who steadfastly refuse to ac- 
knowledge either heredity or environment as separate entities. They 
regard them merely as abstractions, as ways of looking at the whole. 
They believe, with the environmentalist, that a teacher could make any- 
thing out of any child if she only knew enough, but they hold with the 
hereditarians that there must be complete knowledge of the nature of 
the child and complete adjustment of environment to the nature of the 
child on the one hand and to the goal to be achieved on the other. 
They claim that heredity and environment are no more distinct entities 
than matter and energy, good and evil, black and white. No one can 
know matter except thru energy. Good and evil are relatives terms; 
neither one can be brought to consciousness without at the same time 
creating the other. 

The truth is that all educational products are the result of both 
nature and nurture. Changes in one, inevitably, are accompanied by 
changes in the other, and measurement of either separately is unthink- 
able except as one takes the other for granted. For convenience in 
thinking, however, we can define conditions and ascribe variation to one 
factor, then call the measured effect of the variation of that factor 
its effect. Properly speaking, any measurement of effect is always the 
measurement of a single cause. In other words, I am a unitarian. Had 
Terman been here, that illustrious hereditarian for whom I am so im- 
perfectly substituting, you would now be listening to a very different 
doctrine. 

By way of summary let me now present the basic concepts in their 
proper relations, using the convenient conventional language which for 
purposes of ease of understanding deals with each concept as a sepa- 
rate entity. An individual inherits from his parents capacity which may 
be defined as potential ability. Capacity is fixed by the biological process 
of reproduction and does not change with age. It is most correctly 
described and measured as the basic cause of individual differences. 
Capacity is at present beyond control. 

Capacity is acted upon by many forces which may be designated 
by a general term, nurture. These may be subdivided into three classes: 
first, the general developmental factors which we shall call maturity; 
second, the directed but unorganized factors which we shall call social 
influence; and third, the influences exerted by the school, which we shall 
call training. Nurture acting on capacity results in ability. Ability 
may be defined as general power to do. But we never “do” in general; 
we always act in particular situations, elements of which in turn con- 
dition our doing. Thus we have a general power to run, but our actual 
achievement in running varies according to whether we run up hill, on 
the level, or down hill. Score in a test, therefore, is never anything 
more than a performance. It is always a measure of a complex. To 
the degree that we succeed in keeping testing conditions constant, differ- 
ences in performance will reflect differences in ability. In similar fashion 
to the degree that nurture is constant, differences in ability will reflect 
differences in capacity. But nurture is never constant even for twins. 
So the question naturally arises, What are the effects of differences of 
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nurture upon capacity? In reality this question means that if we agree 
to consider heredity constant, and the effects observed as caused wholly 
by differences in environment, what is the relation between the magni- 
tude of the change in the environment and change in the effect? 

The importance of this question arises from the fact that differences 
in the environment are both observable and measurable. For instance, 
we have had surveys of many cities in handwriting. The average 
development curves by grades reveal differences from city to city. These 
differences might be caused by differences in the amount and type 
ef training given or by differences in both. If we assume, or prove by 
direct measurement, that the average capacities of the children in the 
two cities are the same, these observed differences in the results are 
caused by the variation in the nurture factors. That is, the climate 
being warmer in one city than the other may change the rate of matura- 
tion; or one city may be wealthier than the other and supply children 
with better living and growing conditions; or the teaching procedure 
may be better in one city than the other. Before we can reach the latter 
conclusion, however, we must be able to allow for the effect of the 
other variables upon the scores. Hence the need for measuring the 
effect of heredity, maturity, social influences, and school training 
separately. 

The first point to be made is that we do not attempt to measure 
the effect of training as such. Training has no effect. You cannot 
even give training without having something to train and even as you 
give training to children they inevitably become older, more mature. 
To speak of measurement of teaching, therefore, always carries with 
it the implicit acknowledgment that if there were no nature, no ability 
would result from teaching. What we really want to measure is the 
effect of variation in the amount or quality of training within limits 
previously defined and accepted. Recognition of this limitation of what 
is meant by measurement of teaching will save one from many a foolish 
misinterpretation. 

When we compare results of one city with another on this basis, 
we receive severe mental shocks. In general, the effect of school train- 
ing from city to city is fairly constant, seemingly marked variations in 
average scores corresponding to changes in the scores of relatively few 
children. For instance, on the average three-fourths of the children 
would have precisely the same ability whether they grew up in one 
city, in this country or another. These data suggest that the influence 
of all those special factors such as methods of teaching, personality of 
the teacher, home conditions, etc., must either be relatively constant 
from city to city, or else must have very small effects. We know that 
enormous environmental differences actually exist. Therefore, we are 
driven to the conclusion that the effect of these variations is relatively 
insignificant. 

To leave this general theorizing and to get down to “brass tacks” 
suppose we make the general question specific. If we use scores in 
intelligence tests as indices of natural differences in capacity, age in 
months as a measure of maturity, and semesters spent in school as a 
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measure of school training, how accurately can scores in the Stanford 
Achievement tests be predicted from these data? 

By the correlation technique it has been found that for boys and 
girls between the ages of 10 and 13.5 in three Detroit schools, score in 
Stanford tests may be computed by multiplying age by .055, score in 
the National Intelligence tests by .184, score in the Detroit Army in- 
telligence tests by .4, semesters of training by .57, and from the sum 
of the products subtracting 4.3. In other words, the prediction formula 
(regression equation) Y=—.055Age+.184N+.4D+.57T—4.3 corresponds 
to a multiple correlation coefficient of .90. 

I do not know how familiar you are with regression equations. 
Perhaps I ought to explain they are merely statistical devices for find- 
ing the best weight by which to multiply the various factors to predict 
the criterion score with the smallest root mean square error. The equa- 
tion above in no sense represents a law. The values change from school 
to school. Its derivation is based upon unvalidated assumptions. It has 
no intrinsic or permanent value. Law can be determined only by experi- 
mental and statistical procedure, never by either alone. 

The formula does have a value, however, as furnishing a measure 
of how near the rough approximation to a law can come to the truth. 
Let us predict with it. For instance, a child is 137 months old. His 
score in the National test was 78, in the Detroit Army test 43. He had 
spent 11 semesters in school. What is his Stanford score? The com- 
putations are as follows: 


ROG sv tiwesees sun 187 x .055= 7.5 Actual score ............ce-- 41.3 
National .....5.+. 78x .184=14.4 Predicted score .............. 41.1 
Detroit Army .... 43x.4 =17.2 salen 
Es .caveweus llx 57 = 6.3 Ee EE ee —.2 
— ee eee 5 
ae 45.4 
a winswubas 4.3 
Predicted Score........... 41.1 


In this case the formula operates to predict the child’s score with 
marvelous exactness. Unfortunately, all predictions are not so perfect. 
For instance, another child was 131 months old, had a National score of 
99, a Detroit Army score of 30, and 10 semesters of training. Computa- 
tion yielded a predicted score of 49.3 while the actual score was only 
38.8, a result of 10.5 points lower than the actual score, an error of 
28.5 per cent. Evidently the formula is not a perfect one, but even so, 
predictions made by it are remarkably close. For 443 cases, the formula 
reduces the standard error of prediction from 13.7 points when predic- 
tion is based on minimum knowledge, to 6.0 points when based upon 
heredity, maturity, and training. The score of 40 per cent of the children 
can be predicted within a maximum error of 5 per cent, of 65 per cent 
of the children with a maximum error of 10 per cent. 

In other words, heredity, maturity, and training account for so 
much of a child’s development that there is precious little room left for 
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all the influences of home, church, and society put together. The picture 
of education one gets from a study of these results is of a deterministic 
process practically beyond control in which each child moves forward to 
a predetermined end in the most mechanical of fashions. Is it any 
wonder that our hereditarian friends feel that they have a good founda- 
tion for their convictions? Anyone who closes his mind to such data 
as these and refuses to consider their implications for daily practice 
in the classroom is as foolish as he who takes them at their face value 
and refuses to look beyond them. 

Nor need anyone feel that the conclusions are in any way conditioned 
by the statistical assumptions made in deriving the regression equation. 
From what has been said you will readily understand that I do not con- 
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sider those assumptions as valid or the resulting formula more than a 
convenient and temporary tool for analytical study. The important 
data are susceptible on simple and objective presentation. In figure 3 
the heavy horizontal line represents the actual scores of 50 children 
selected at random from the larger group of 443 cases for which predic- 
tions have been made; the vertical lines indicate how far the predicted 
score was away from the actual score. The actual data are given for 
the extreme case at the left. The child was 153 months old, made a 
score of 142 in the National tests, 65 in the Detroit Army, and had been 
14 semesters in school. The predicted score was 64.2 while the actual 
score was 79.2, an error of 15.1 points or 23.5 per cent. The vertical line 
at the left may be seen to represent 15.1 points by the vertical scale 
beside it, and from the vertical scale the size of all the other errors may 
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be determined. The solid line joining the tops of the vertical lines thus 
marks out the area of errors of predictions. There are only 25 vertical 
lines drawn in the figure because half of them were omitted for the sake 
of clearness. The area enclosed by the solid line, however, represents the 
errors of a random sampling of 50 cases. 

Now not all of this area is real error. When we give a Stanford 
test and then repeat it two days later the children do not make precisely 
the same score on the second trial that they did on the first one. The 
average difference for 78 cases tested twice two days apart was ap- 
proximately 3 points. For instance, in a random sampling of 50 cases 
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the greatest variation in score was a change from 45.9 to 55.8, an error 
of 9.9 points. This, it will be noted, is also represented by a part of the 
line at the extreme left, and the area representing the entire portion 
of the prediction errors due to chance has been shaded, the boundary 
being indicated by the broken line. The space between the dotted and 
full line thus represents the portion of the errors of prediction which are 
not fully accounted for by chance errors. I note that for 90 per cent 
of the cases the total distinctive influence of home, church, state, 
society, and teaching cannot exceed 4 points. Perhaps a more cautious 
statement would be that with our present imperfect instrument of 
measurement, if there is any effect beyond 4 points it is hidden from 
view by the chance errors. In figure 4 the same facts are presented 
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as per cents of error instead of in points of score, on the assumption 
that to make an error of 5 points in predicting a score of 100 has less 
significance than in predicting a score of 50. In this figure the irregu- 
larities are smoothed out somewhat but the general conclusion is not 
changed. For 80 per cent of the cases the effect of the social factors 
cannot exceed 5 or 6 per cent. 

The average school teacher upon seeing these results for the first 
time reacts to them somewhat as follows: “How absurd. If these 
conclusions were true, I should certainly have observed this mechanical 
process in my classroom. I have seen nothing of the kind. I can also 
show you plenty of cases where the children have been completely 
changed by my teaching. I feel I have perfect freedom to make changes 
and I am conscious of no hampering restrictions of the character repre- 
sented by these conclusions.” 

The answer of course, is simply a reinterpretation of the teacher’s 
own remarks. She considers only the children who grow, never stopping 
to ask herself what it was that made her teaching effective in some 
cases and not in others. She herself admits that only some children 
grew altho the opportunities were there for all. The fact of the matter 
is that variations in heredity, maturity, and training fully account for 
these variations. The teacher presented an opportunity, and the children 
responded in terms of the variations in the basic factors of heredity, 
maturity, and training. The teacher did not, and does not, know how 
to control the growth. The distinctive influence of the teaching plus 
all other social factors account for not more than 5 per cent in the total 
variation. 

Suppose, for instance, we select.10 children making approximately 
the same score, 48, and compute what these scores would have been 
had the amounts of heredity, maturity, and training been the same. 
The scores spread out into a range of from 43 to 54, proving that in- 
dividuals who achieve a score of 48 do so by a very different combination 
of basic factors. Similarly it is possible to select 10 scores ranging from 
37 to 55, such that, if the children had all had equal amounts of heredity, 
maturity, and training, their scores would all have been 45. (Figure 5) 
Furthermore, if we examine the results of surveys in different cities 
we shall discover a surprising constancy of average scores. 

Perhaps, however, the best confirmatory evidence comes from at- 
tempts to measure the influence of social factors directly. Under a grant 
from the Commonwealth Foundation, I have been carrying on for a 
number of years a study of the effects of nature and nurture. We not 
enly tested children in school; we also sent investigators into the homes. 
One of the subjects of inquiry was church membership and attendance 
at Sunday School. I cannot discuss the details of that investigation here 
but I can give you briefly one of the conclusions and the evidence on 
which it is based. I finally was able to make up 5 groups of matched 
scores of 15 scores each. The reason the groups were not larger is 
because there were few families in the neighborhood under investigation 
that did not profess church membership. Two of the groups called 
Experimental A were composed of the score of children from families 
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EFFECT OF CORRECTION TO STANDARD CONDITIONS 











Actual Corrected Actual Corrected 
55 4 
55 + 
+ 53 53 - 
§1 
. 61 a 
49 - 
+ 49 47 - 
45 4 45 
47 ; 
43} 
+ 45 41 ; 
39 3 
43 : 
37- 


Fic. 5. When ten Stanford scores selected as equal (48.0—48.9) are 
corrected to standard amounts of heredity, maturity, and training, their 
differences from 43 to 54 become evident, and conversely when scores 
which range from 37 to 56 are corrected to standard conditions their 
essential equality is revealed. 


who said they were church members and who actually had their chil- 
dren in attendance at Sunday School the Sunday before the investigation 
was made. The children in school on Monday were asked to write 
an account of what they did on Saturday and Sunday. Where the 
parents that said they were church members and that their children 
went to Sunday School while the children’s accounts told about going 
to a movie or picnic or gave other evidence that the family did not take 
its church membership very seriously, the scores were put in Experi- 
mental Group B. The control group was of course made up of children 
who did not go to Sunday School and whose parents frankly said they 
did not belong to any church. By making two groups in both of the 
larger divisions A and B it is possible to check one against the other to 
determine the reliability of the results. The raw scores are given in 
Table 1. It will be observed that all the groups have approximately 
the same variability. 

When scores are matched this way, the three basic factors—heredity, 
maturity, and training—are never the same. If now we correct all of the 
scores to the same heredity, maturity, and training, the influence of the 
one special factor in which they differ will be revealed. (See Table 2.) 
Note that in the corrected scores the divisions in Experimental Group 
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A have higher scores than the rest, but that Experimental Group B 
shows little effect from church membership. If now, the Experimental 
Group B is grouped with the control group and compared with Experi- 
mental Group A the difference is 3.95 points or 6 per cent. These results 
agree with those previously shown and make it quite certain that under 
present conditions the distinctive influence of all the special factors 
to which we pay much attention is very much less than we have believed. 


TABLE 2 


COMPARISON OF MATCHED GROUP SCORES AND STANDARD 
DEVIATIONS IN STANFORD WHEN EACH INDIVIDUAL SCORE 
IN EACH GROUP HAS BEEN CORRECTED TO STANDARD 
HEREDITY, MATURITY, AND TRAINING 


Age of 143 months, National score of 122, Detroit Army score of 62, training 
score of 11.8 semesters. 


S. D.’s rrom TaBie IV To 
Suow REDUCTION BY 








NUNBER | 








CorRRECTED STANFORD | 
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CoRRECTION 
Groups OF | | 
Cases |Mean|S.D.|S.D.M.| S.D. | S.D.M. 
= a —_ a ee 
(1) (2) | (3) | (4) (5) | (6) (7) 
| SSeS CS GE a 
Experimental A: | | | 
Section 1.... 15 65.03 | 5.89/ 1.52} 9.11 | 2.35 
Section 2... .. 15 64.84 6.95| 1.79) 8.23 | 2.12 
| |__|. + saa cisihcte hale 
Difference. ...|........ | 0.19} 1.06) 0.27) O88 | 0.28 
Experimental B: | | 
Section 1...... 15 61.59 | 6.22) 1.61 8.84 | 2.28 
Section 2...... 15 | 60.99} 5.91} 1.53} 9.03 | 2.33 
Difference. ...|........ | 0.60| 0.31| 0.08} 019 | 0.05 
Control C....... | 15 160.98| 4.55] 1.17] 8.84 | 2.28 
Experimental D...| 30 | 64.93 | 6.10 | 1.11 | Sections 1-A and 2-A. 
Control E........ 45 | 61.19 | 5.40 | 0.80 | Sections 1-B, 2-B, 1-C 
— — ~ = — — — = = = = _ — 
NS aioe gia ok 3.74 % of 61.19=6.1 per cent. 


Extreme difference, from lowest control to highest experimental, 4.05 or 
6.6 per cent. 


If one accepts this conclusion tentatively and seeks for an explana- 
tion, it will not be long before he will be driven to the conclusion that 
the trouble lies in the fact that our subjects and methods of teaching 
have not been validated. As educationalists we have not yet isolated 
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the significant factors, consequently much of what we do does not hit 
the mark. We are working in the dark as blindly as the alchemists who 
attempted to develop a science on the basis of fire, water, earth, and air 
as elements. This evening I shall try to indicate what I think we 
should work for in education, but at present I want to indicate my belief 
that we are on the verge of making very important discoveries in educa- 
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tion, discoveries which will yield new concepts of essential elements, 
new methods of measurement, and lead to new forms of control. 

For instance if we graph the scores of certain of the mental tests 
given by Burk to London school children we obtain a set of curves which 
show consistent and orderly characteristics. All have a characteristic 
form. They begin slowly, rise rapidly, and round off slowly. The more 


RATE OF MATURATION - GIRLS- FIRST MENSTRUATICN 
ABERNETHY - 487 
























100 PER CENT MATURE 
— — RATEOF MATURATION 
154 
SIGMAS .75 
MATURI 
so} MATURITY m 
si 
254 
P 36669 Zs BZ NBM 
. =: eS shee 
AGF 
Fig. 7 


difficult the test, the later its rise and the smaller the angle of slope 
it makes with the base line. If we give a number of words in spelling 
to all the children in three or four schools and keep the results for each 
word distinct we obtain precisely similar curves. Similar tabulations for 
many subjects and traits yield similar results. How are such curves 
to be explained ? 
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Recently we have had a very careful study of a single physical 
aspect of physiological maturation. Miss Abernathy found that at 10 
years of age not one girl of the group of 487 which were under con- 
tinuous observation for a period of seven years was mature. At the 
beginning of the eleventh year, 1 per cent were mature; at the beginning 
of the succeeding years the per cents mature were 8.6, 31.6, 66.9, 92.2, 
98.2, 99.8 per cent, and the curved line in the figure represents these 
percentages graphically. 

Suppose now we think of this group of girls with respect to the 
onset of menstruation as a normal distribution, and think of this normal 
distribution as having two motions: one progress to the right with age, 
the other progress across the maturity line with age. The successive 
positions of the distribution are shown in the figure, and the part across 
the maturity line is shaded black. Note that under these conditions the 
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line joining the centers of the different positions of the distribution is 
approximately a straight line. 

In other words, the compound curve shown in the figure is really a 
function of two factors, one of which is a measure of the extent of 
individual differences, differences in original nature or heredity as I 
have called it. Let us represent the factor by N. Another factor is 
evidently the rate of maturation. At 11 years, 1 per cent of the girls 
were mature. That means that if the base of the distribution is taken 
as 6 sigma, .73 of a sigma of the base line was across the maturity line. 
At 12 years, 1.64 sigma was across the line. In one year therefore the 
distribution had risen .91 sigma units. ‘The next year the rate of rise 
was .88 units, and the succeeding values are .91, .78, .76, .64. The 
rate is not absolutely constant due probably to an increase in variability 
with age, but the line in the figure which is accurately drawn shows how 
near to a constant rate the data came. Now, 487 girls is a small sample 
of the total number, and if adequate data were secured it is probable 
that these irregularities would disappear. The important thing about 
these results is that this complete curve can be adequately represented 
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by a very similar formula. y=NRT in which y equals the per cent 
of girls mature. N, stands for the difference in nature; R, the rate 
of maturation and, T, the time. In other words, the relationship between 
the factors which determine educational products is not a rectilinear 
relationship but a much more complex one than has been believed. We 
cannot at the present predict the educational scores from definite meas- 
urements of the variables concerned, but it is evident what those 
variables are, and the discovery of the appropriate measurements to be 
made may be announced any day. When that time comes we shall have 
a more fundamental method of measurement for a given type of teach- 
ing ability than at present. For instance, in Figure 8 the four curves 
shown are the development curves for the single word “lake,” the curves 
being based upon the per cent of correct responses by half-years. The 
word “lake” is ordinarily taught when the child reaches 8 years of age 
or in the third grade. Consequently the first part of the curves repre- 
sents learning in advance of teaching. Note that schools A and B 
started at the same time while schools C and D have lower curves. This 
means that the hereditary difference and the social training of the chil- 
dren in schools C and D differ from those in A and B and are greater in 
D than in C. Notice also the difference in the later development curves. 
The teaching in schools A and D was better than that in School B and C, 
for the rate of maturation indicated by the relative slant of the curves is 
greater. Notice the parallelism between the services of B and C. B has 
better material upon which to operate, but the effects of teaching in the 
schools are closely the same. 

These surveys are based upon about 500 children in each of the 4 
schools. A further significant point shown in the figures is that repre- 
sented by the dotted line in the case of school D. Under “teaching,” 
notice the very large jump from a very low score at 7% years, to a 
high score at 8 years. Notice also the rapid decay of this ability until 
the optimum development is reached. On the other hand, note that in 
school A in which the effects of teaching are equally marked no such 
decay takes place. It is in changes of this type of development that I 
personally believe that our estimates of the nature and value of different 
kinds of educational procedure are going to be determined. From such 
cata as these amassed in very large quantities it is becoming increas- 
ingly clear that no form of control by the school will be adequate for 
the individual. The one method by which education can be secured is 
thru the adjustment of subject-matter to children’s needs. Around the 
world today, as in the children’s University School, or in the schools of 
Winnetka or Detroit, and many other places experimental work in the 
individualization of instruction is steadily going forward. The results 
achieved lead us to believe that it is along these lines that improvement 
of teaching will ultimately be obtained. The day of the child has come. 











Education in Indiana in the Light of Research 


By Henry NosBLe SHERWOOD, State Superintendent of Public Instruction 
and 
JOHN DALE RUSSELL, Statistical Clerk, State Department of Public 
Instruction 


THE citizens and taxpayers of Indiana are today very much interested 
in their schools. They are aware of the large amounts of tax money 
that are annually going to education, and they are beginning to ask for 
definite information as to the educational results that are being obtained. 
As judged by letters coming to the State Department of Public Instruc- 
tion, one of the most frequent forms in which the public phrases its 
inquiry about our schools is: “What rank does Indiana hold in educa- 
tion among the states of the Union?” The first part of this paper is 
given to this question with a view of suggesting some sources of in- 
formation on the question of Indiana’s rank in education, together with 
criticism of the information that has been published regarding state 
rankings in education. 

There are two well-known educational rankings of the state. The 
first was made in 1920, based upon 1918 data, by Dr. L. P. Ayres, and 
published by the Russell Sage Foundation under the title “An Index 
Number for State School Systems.” Ten items were used by Dr. Ayres 
in building up a composite index showing the relative ranking of the 
states educationally. These ten items were: 

1. Per cent of school population attending school daily. 

2. Average days attended by each child of school age. 

3. Average number of days schools were kept open. 

4. Per cent that high school attendance is of total attendance. 

5. Per cent that boys are of girls in high schools. 

6. Average annual expenditure per child attending. 

7. Average annual expenditure per child of school age. 

8. Average annual expenditure per teacher employed. 

9. Expenditure per pupil for purposes other than teachers’ salaries. 
10. Expenditure per teacher for salaries. 


It is clear that this index really dealt with only two types of in- 
formation: first, school attendance; and second, school expenditures. 
In other words, the only ways in which a state might improve its 
standing in this index would be to spend more money for schools, or to 
improve its school attendance. 

In the Ayres index, based on 1918 data, Indiana held seventeenth 
rank among the states, Montana being first and California second. 

The second well-known educational ranking of the states is by Dr. 
Frank M. Phillips, made in 1924, based on data for the year 1922. It 
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was published first in the American School Board Journal for December, 
1924. It is also published in pamphlet form by the Bruce Publishing 
Company, of Milwaukee, Wis. 

Dr. Phillips’ ranking was a revision of the Ayres index, employing 
a different statistical procedure. He used the following ten items: 


1. Percentage of illiterates ten years of age and over. 

2. Ratio of number of children in average daily attendance to number 
5 to 17 years of age inclusive. 

3. Percentage of attendance in high school. 

4. Average number of days attended by each child enrolled. 

5. Average number _of days schools were kept open. 

6. Ratio of number of students taking normal training courses to 
number of teaching positions. 

7. Percentage of high school graduates continuing their education. 

8. Total cost, excluding salaries, per pupil in average daily attendance. 

9. Average annual salary of teachers, principals, and supervisors. 

10. Total amount expended per child of school age. 


With the exception of the item of illiteracy, this index again is based 
almost exclusively on data relating to financial expenditures or school 
attendance. Items 2, 3, 4, 5, 8, 9, and 10 correspond very closely 
respectively to items 1, 4, 2, 3, 9, 10, and 8 on the Ayres index. Thus 
seven of the items are almost the same as those on the Ayres index, 
the only changes being the inclusion of items of illiteracy, prospective 
teacher situation, and high school graduates continuing their education. 

In Dr. Phillips’ ranking, Indiana held fourth place, Washington first, 
and California second. Direct comparison between the rankings on the 
two indices by Ayres and Phillips is not possible, both because of the 
inclusion of some different items, and also because of different statistical 
procedures used in deriving their final ranking. 

Both of these rankings of the states are open to criticism. In the 
first place, it is obvious that the ranking is made on a rather limited 
list of items. There are many kinds of information, other than ex- 
penditures and attendance, which we need to take into account before 
definitely deciding how any state ranks. The excellence of the school 
buildings, the qualifications of teachers, and the subject-matter achieve- 
ment of pupils are very important items which do not appear in these 
indices. 

In justice to Dr. Ayres and Dr. Phillips, it should be said that the 
complete data were not available. It was necessary to use whatever data 
had already been collected and were available for all the states. Further- 
more, it is possible that the items not included would show the same 
trends as the items used and consequently would not affect the final 
ranking even if included. This would need statistical proof before 
being accepted. The lack of uniformity among the individual ranks on 
the separate items used (which will be referred to later) would indicate 
that the inclusion of some additional items might materially affect the 
final ranking. 

In the second place, not only do these indices omit any measure 
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of what the pupils are actually achieving in their schools, but there is 
also entire omission of any measure of the ability to support schools, 
or the effort put forth to maintain educational facilities. It should be 
clear that a state that provides just an average school system in the 
face of severe restrictions of wealth or backward population is mak- 
ing a more creditable showing than a state maintaining superior schools 
without such handicaps. 

For example, Dr. H. F. Clark,* speaking about the effect of the 
variations among the states in the ratio of number of children to num- 
ber of adults, says: “As an illustration, because of the difference in the 
number of children” (i.e., in proportion to adult population) “California 
would have to send each child thru the university to provide as much 
schooling as South Carolina would provide in sending each child thru 
eight grades. Needless to say, South Carolina is probably providing 
more education than California.” This last sentence is a very striking 
statement, in view of the fact that on both the rankings of the states, 
South Carolina is at the very bottom of the list, while California is 
practically at the top. 

It is evident that information regarding where Indiana ought to 
rank educationally is necessary if any valid interpretation is to be made 
of where the state does rank, supposing the information on the latter 
point to be wholly reliable. Even if we should finally agree that Indi- 
ana schools do rank fourth, and then should discover that from con- 
siderations of wealth and distribution of population Indiana holds an 
even higher rank with respect to ability to support schools, we should 
certainly feel justified in expressing dissatisfaction with our present 
rank. 

A third criticism, which applies particularly to Dr. Phillips’ rank- 
ing, arises from the failure of the composite, or final ranking, to agree 
closely with the various rankings on each of the individual items. 
For instance, here is Indiana’s rank on each of the ten items used in 
Dr. Phillips’ ranking: 


TABLE 1 
Item (1922 data) Indiana’s Rank 

SN aia ac eka hear vena <eadew ins einai 12 
2. Ratio of a.d.a. to number children 5 to 17 years of age.. 18 
8. Per cent of attendance in high school.................. 10 
4. Average number of days attended by each child enrolled.. 23 
5. Average number of days school was kept open........... 34 
C. Dee Se Psa 0 ois 0a hoes dx cancnsnc peter us 11 
7. High school graduates continuing their education....... 17 
8. Total expenditures for schools, exclusive of salaries..... 2 
i I Is bia von so wccccbneconvecd Weewnn 15 
OE ee I I I ong cece oes cececnwipeddween 7 

PEGE SORES GM GONE OF THIER. 6c cc eccccvcccceventses 4 


*The Effect of Population upon Ability to support Schools, p. 11, published by 
Bureau of Coéperative Research of Indiana University. 


EDUCATIONAL MEASUREMENTS CONFERENCE 45 


Thus it is apparent that in only one item did Indiana rank as high 
or higher on the individual items as it did on the final ranking. Is it 
not much more significant to know that Indiana ranked thirty-fourth 
with respect to number of days school was kept open, or twelfth with 
respect to illiteracy, or fifteenth with respect to average salaries of 
teachers, than to know that a composite of these important items and 
seven others gives Indiana a rank of fourth place? 

A complete criticism of this ranking of the states would involve a 
technical analysis of the statistical method used in compiling the final 
ranking. From this point of view, the method is open to several criti- 
cisms, which will not be presented here. 

By way of supplementing the rather limited range of informational 
items upon which these two indices are based, attention should be called 
to a rather comprehensive report recently issued by the Public School 
Publishing Company giving tables which show the scores made upon 
tests in a nation-wide survey, in problem-solving and in language usage. 
These tests were taken by thousands of pupils in almost every state in 
the union. The medians which have been compiled are thus based upon 
one of the largest groups of pupils ever used for the standardization of 
tests, the totals being well over 100,000. Several thousand Indiana 
pupils took the tests. The tests used were the Stevenson Problem 
Analysis test, form 2, and the New York English Survey tests in Lan- 
guage Usage (two parts) and in Grammar. 

Perhaps the most interesting parts of these reports, for our pur- 
pose, are the tables of median scores by grades for each of the states 
by grades. This is one of the first opportunities we have ever had to 
see how Indiana boys and girls rank in subject-matter achievement in 
comparison with pupils in other states. Here are the facts shown by 
these tables. 

In the problem-solving tests, Indiana is consistently below the 
median for all the states in every grade. Indiana in general ranks in 
the lowest third of the group of about forty states from which returns 
were received. 

The English tests were in three parts, two on language usage and 
one on grammar. On the first language usage test, Indiana again ranks 
low in every grade, falling into the lowest third of the group of states. 
On the second part of the language usage test, Indiana ranks at just 
about the median in all grades except the seventh, which is consid- 
erably below the median. On the grammar test, which was given only 
to seventh and eighth grade pupils, Indiana’s seventh grade is below the 
median, while the eighth grade has ninth place in the list of 33 states. 
This is the most creditable showing of any Indiana grade in any of the 
tests. 

Do these results come as a shock to us in Indiana? We have 
pointed with considerable pride to the fourth place among the states 
which Dr. Phillips assigned us in his ranking a year ago. Do these re- 
sults indicate that his ranking was not based on a complete analysis 
of the situation? Certainly it is difficult to imagine how a state whose 
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educational system was ranked fourth could show a pupil achievement 
consistently below the median in these two fundamental school subjects. 

Perhaps the results of this testing survey are also open to criti- 
cism; but it is difficult to question their validity when they are based 
on so many thousands of cases. At any rate, these test results would 
be sufficient to throw considerable doubt upon the validity of a ranking 
system which gives Indiana fourth place among the states. 

These criticisms of the two well-known rankings of the states have 
been presented for the purpose of showing the degree of caution which 
should be observed in talking about the rank of the states in educa- 
tion. In fact, the authors of the ranking systems themselves recom- 
mend this caution. Dr. Phillips heads his tables “State ranks in cer- 
tain items” (italics supplied). So interpreted, the data presented are 
valuable. But, unfortunately, many people who read such studies re- 
port only the conclusions without reference to the various qualifying 
statements; and thus it is commonly reported and currently believed 
that Indiana ranked seventeenth among the states in 1918 and in 1922 
her rank was fourth. 

The fairest statement that could be made is that there is at present 
no ranking of the states educationally which adequately measures their 
relative standings with respect to any comprehensive view of their school 
systems. This conclusion is borne out by the concluding sentences of 
Dr. Phillips’ pamphlet (p. 32), which are here quoted: “All that can be 
said is that when the computation is done in this particular, and perhaps 
peculiar manner, certain values result. With this in mind, state ranks, 
and indices showing progress, need to be used with a great deal of 
caution.” 

These criticisms do not imply that an attempt to secure an accu- 
rate ranking of the states educationally is in itself wrong. It would be 
very valuable to have such information, and undoubtedly even the partial 
information which we now possess can be used advantageously. The 
thesis of this part of the paper is that the comparative information 
which we now have regarding education in the states of the Union should 
be used cautiously, bearing in mind all the limitations of the data from 
which the state ranks were derived. 

Everyone who is familiar with the administrators of Indiana schools 
knows that the state is making progress in education. There never was 
a time when more interest was shown in our schools. There never was 
a time when school matters were more divorced from partisan politics. 
There never was a time when Indiana had better teachers, better build- 
ings, better equipment, or put more money into her schools. No one 
has definitely given Indiana a specific ranking which includes all the 
items that go into an all-comprehensive rating scale, and it is impos- 
sible at this time fully to determine with exactness the absolute place our 
state holds. However, we believe in the spirit of the teaching profes- 
sion in Indiana; we believe our state holds a place in the front column 
of the nation’s educational forces; and we confidently hope to see our 
state adopt progressive educational policies as rapidly as their worth 
is manifestly demonstrated. 
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The second division of this paper relates to the cost of school sup- 
plies. 

In Indiana, the local school corporation is the unit by which school 
supplies are purchased. That is, each school township, school town, 
and school city purchases its own supplies independently. These units 
vary considerably in size, from the large school city, such as Indian- 
apolis, enrolling thousands of children, down to small towns with fewer 
than one hundred enrolled pupils. The townships in general are com- 
paratively small units, the average number of enrolled pupils per town- 
ship being 390. This variation in the size of the administrative units 
naturally produces a large degree of variation in the quantities in 
which school supplies are purchased. It is manifest that a unit which 
must buy chalk for 5,000 pupils will as a rule buy in larger quantities 
than will a unit of 500 pupils. 

It is a matter of common business observation that the price of a 
given commodity varies inversely as the quantities in which purchase- is 
made, the price being free to change. Thus one would expect to buy 
potatoes by the carload at a lower price per pound than if the purchase 
was by the peck. By similar inference, it might be expected that the 
size of the school administrative unit will to some extent affect the price 
paid for school supplies, and consequently the purchasing power of the 
corporation. 

The study here reported was undertaken to see what is the variation 
in prices of school supplies among Indiana school corporations, and to 
see the degree to which the size of the purchasing corporation affects 
the price it pays for school supplies. 

Two typical items of school supply were chosen, chalk and erasers. 
These items were used because practically every corporation purchases 
them every year, because the items are easily definable, and because 
prices can be based on comparable units. It would have been desirable 
to include a larger number of items, but it proved difficult to discover 
other items meeting the three criteria mentioned above. For instance, 
coal would have been a good item to study, but it fails to meet the 
necessary statistical criteria: (1) many corporations do not purchase 
coal, but use wood for fuel; (2) coal varies enormously in quality, and 
it is easily possible that one corporation might pay double the price 
for coal that another is paying, and still be buying its fuel cheaper; 
(3) prices of coal are not always based on comparable units, it being 
priced per bushel in some localities, and per ton in others. The item 
of coal is mentioned merely to illustrate the application of the criteria 
of annual purchase, definiteness, and comparability of unit, and to show 
why other items than chalk and erasers were not included in the study. 

Information as to prices paid for these two items of school supply, 
chalk and erasers, was secured in two ways. From the school cities 
and towns of the state information was obtained by questionnaire. From 
the townships, information was taken from the vouchers on file in the 
office of the State Department of Public Instruction. These vouchers are 
filed by state-aid corporations for the purpose of establishing their eli- 
gibility to reimbursement, and constitute, therefore, an authentic source 
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of information. A large number of these vouchers were looked over, 
and prices paid for chalk and erasers were tabulated. 

For the purpose of studying the relation of the size of the purchas- 
ing unit to the prices paid for supplies, the corporations were grouped 
according to the number of enrolled pupils, this being taken as a rather 
satisfactory index of the relative quantities in which supplies would be 
purchased. The towns and cities were grouped into five classes: those 
enrolling 5,000 and more pupils, those enrolling 2,000 to 4,999 pupils; 
1,000 to 1,999; 500 to 999; and 100 to 499. The state-aid townships 
formed the sixth group, having approximately the same number of pupils 
as that of the group of smallest towns and cities. 

The prices for chalk were reduced to the price per gross, or box. 
Chalk is usually priced per case of 25 boxes, but many of the corpora- 
tions do not buy a whole case at a time, so in order to have absolute 
comparability of price, it was expressed as a price per gross. The 
prices for erasers were given as the price per dozen erasers. 

Table 2 shows the median price paid for chalk in each group of 
corporations, and also the number of corporations in each group from 
which data were obtained. 

Chart I presents graphically the progression in median prices which 
accompanies a change in size of the purchasing units. Note how the 
line connecting the median prices slopes from the low point in the group 
having the largest enrollments, growing ever higher as we go thru the 
corporations having the smaller enrollments, and reaching its highest 
point in the state-aid townships. These median prices range from 37 
cents per gross to 53.3 cents, a range of approximately one-third the 
median price paid in the state-aid townships. In other words, if these 
state-aid townships bought their chalk at as advantageous prices as the 
average of cities enrolling over 5,000 pupils, their expenditures for this 
item would be reduced one-third. 

It will immediately be suggested that there are several kinds and 
qualities of chalk, and that perhaps the foregoing data merely indicate 
that the bigger corporations are simply buying a cheap grade of sup- 
plies. Statistically, it is a fair presumption, when medians are used, 
that the average quality bought in one place will be just about the 
same as the average in another place. But in order to be sure of this 
point, a new tabulation was made including only those corporations which 
specified that they were buying one particular grade and brand of chalk, 
Hygieia Dustless. This particular brand was chosen because it was 
specified more frequently than any other in the corporations from which 
the data were secured. 

In this new tabulation, no corporation was included unless it posi- 
tively identified the chalk it was buying as Hygieia Dustless. Naturally 
this reduced the number of corporations used in each group, but the 
numbers are still sufficient for purposes of comparison. The same 
grouping by size of corporation was used as in Table 2. The data for 
prices paid for Hygieia Dustless chalk are shown in Table 3. In this 
tabulation, lowest and highest prices, as well as the median, are shown 
in each group. 
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TABLE 2 
Median prices paid for chalk (all kinds) per gross 

Corporations by Number of Median price 
enrollment groups corporations paid per gross 

5,000 pupils and over ............. BiWasvnrcexdaaaenmd ener 37 

2,000 to 4,999 pupils ............. Div scts wba awe beeen 415 

Be Oe BR ga sndciicvcnodavaeeen RES ERR Pe 438 

Se Ne re cc ns Chae ere cen Bly cdiovessat.o bao MO eta hee 45 

ee Se ctanaide cs baewecenens Ee .50 

State-aid townships .........cce> Bs ts sé acta eee ee Oke 533 


Chart I shows the data of Table 2 graphically. 
Chart TI 
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TABLE 3 
Prices paid for Hygieia Dustless Chalk (per gross) 








Cities by Number of Prices Paid 
Enrollment Groups Corporations Lowest Median Highest 
5,000 pupils and over................. ee 3889 425 
2,000 to 4,999 pupils. .............. 7, & . 3844 42 495 
1,000 to 1,999 pupils. .............. Fee 46 525 
fe 13 six Se 50 55 
100 to 499 pupils........... a a 54 .60 
State-aid townships. ............ | Se .54 583 
The data of Table 3 are shown graphically in Chart II. 
Chart IT 
Highest, Median, and Lowest Prices Paid for 
HYGIEIA DUSTLESS CHALK (per gross) 
in Indiana school towns and cities (grouped according 
to school enrollment) and also in state-aid townships. 
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The codrdinates on Chart II are the same as those of Chart I. In 
Chart II, the median prices for each group of school corporations are 
connected by the solid line, the broken line connects the highest price 
paid in each corporation, and the dotted line shows the lowest price 
paid. This chart again shows very clearly the progression in median 
price, in highest price, and in lowest price as we go from one group 
of corporations to another. The extreme range is from 33 cents per 
gross to 60 cents. 

It is interesting to note also, in this chart, that there is a wide 
range of prices paid within corporations of the same size. Some smaller 
cities are buying more advantageously than some of the larger corpora- 
tions. 

The data of this chart do not show how the prices are distributed 
in each group of corporations. That is, the lowest price, the median 
price, and the highest price are shown, but the other prices are omit- 
ted. Table 4 shows the distribution of all prices, that is, the way they 
scatter along the range from lowest to highest. For the purposes of 
this tabulation, prices were grouped in five-cent intervals, and the 
per cent of all the cases of each group of corporations falling within 
each price interval was calculated. These figures are given in Table 4. 


, TABLE 4 
Distribution of Prices Paid for Hygieia Dustless Chalk 





Per CENT oF EACH CorPoRATION Group PaytnG A GIVEN PRICE 
Prices 1 | ——____—_- 


CENTS 5,000 | 2,000 to | 1,000 to 500 to 100 to | State-aid 
Per Gross | Pupils | 4,999 1,999 999 499 | Town- 
and Over| Pupils Pupils Pupils Pupils ships 
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.525 to .5749|.......... anaaetel ae See 58 | 79 
.575 to .6249|.......... Re | 8 


Table 4 is read as follows: 20 per cent of the corporations having 
enrollments of 5,000 pupils and over were paying between 32% and 37% 
cents a box for Hygieia Dustless chalk; 60 per cent of the corporations 
of 5,000 pupils and over, 67 per cent of the corporations enrolling from 
2,000 to 4,999 pupils, and 25 per cent of the corporations enrolling 1,000 
to 1,999 pupils, were paying between 37% and 42% cents a box for 
Hygieia Dustless chalk; etc. 

This table again shows clearly the progression in the distribution 
of prices which accompanies the change to smaller purchasing units. 

The prices paid for erasers were treated similarly to those for 
chalk. Table 5 shows the median prices paid for erasers (kind and 
quality not considered) in each of the groups of corporations. 
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TABLE 5 


Prices paid for Erasers (all kinds) per Dozen 


Corporations by Number of Median Price paid 
Enrollment Groups Corporations per Dozen Erasers 
5,000 pupils and over. .............. 8 1.27 
2,000 to 4,999 pupils. ............... 15 1.35 
3,000 to 1,900 puptla. ..... 22... eee 15 1.50 

500 to 909 pupils................ 22 1.68 

100 to 499 pupils................ 29 1.65 
State-aid townships. ............... 13 1.45 


Table 5 again shows clearly the progression in median prices as 
we go in the direction of smaller purchasing units. This tendency is 
marked, with the exception of the state-aid townships. This irregularity 
may be due to the fact that many of these townships are buying the 
cheaper wooden-back erasers, while every one of the cities (with one 
exception) are buying felt erasers. 

In order to overcome this variation in quality of erasers (which is 
more marked than in the case of chalk), a separate tabulation was 
made of the prices paid for six-inch felt erasers. This size was chosen 
because it was specified definitely by more corporations than any other 
size. By limiting the data to this particular size of felt eraser, the 
prices are placed on a practically comparable basis. It is true that 
there are small differences in the various brands of this one size of felt 
eraser, but the range of difference is very small, and we are informed 
by men who know the school supply business well that “six-inch felt 
erasers” may, for practical purposes, be considered essentially a stand- 
ard unit. In this compilation, therefore, only those corporations which 
definitely specified this size and type of eraser were included. Since the 
size was not specifically asked for on the questionnaire, the limitation 
excludes a large number of corporations, and our conclusions must 
necessarily be based on fewer cases. None of the state-aid townships 
specified the size of the eraser bought, so that the data for these cor- 
porations are entirely omitted. 

Data giving the lowest, median, and highest prices paid for six-inch 
felt erasers in the city and town corporations are shown in Table 6. 


TABLE 6 
Prices paid for Six-inch Felt Erasers (per Dozen) 


Prices paid for Six-Inch Felt 


Corporations by Number of Erasers 
Enrollment Groups Corporations Lowest Median Highest 
5,000 pupils and more................ wins CS $1.48 $1.51 
2,000 to 4,999 pupils. ...... pivad tack ened 1.375 1.53 1.68 
1,000 to 1,999 pupils. ............ Pa SS acs 1.40 1.75 2.15 
500 to 999 pupils. ... Sy eee ee eee a: 1.40 1.80 2.70 
100 to 499 pupils. .... Ry 1.65 1.95 3.05 


The data of this table are shown graphically in Chart JJJ, 
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In Chart III median prices paid by each group of corporations are 
connected by a solid line, highest prices by a broken line, and lowest 
prices by a dotted line, as in Chart II. Here again, the progression is 
well defined, except in the case of the lowest prices. The low range in 
the case of cities of 5,000 enrollment and over and also in the group of 
2,000 to 4,999 is perhaps due to the fewness of the cases in these groups 
specifying this type and size of eraser. It is reasonable to expect that, 
if data were secured from more corporations, the range from lowest to 
highest would probably be increased; but, if our sampling has been fair, 
it is unlikely that the median would be seriously disturbed. 

What conclusions do we draw from this study? First of all, it 
is evident that, in general, prices on school supplies follow the well- 
known economic law of varying inversely with the quantity in which 
purchase is made. 

In the second place, attention may be called to the fact that the 
amount of this variation is large. In the case of chalk, the extreme 
range, for exactly the same kind of chalk, was from 33 cents to 60 
cents per box, a range equivalent to 45 per cent of the highest price 
paid. In the case of erasers, the extreme range was from $1.375 per 
dozen to $3.05 for the same size and kind of erasers, a range equiva- 
lent to 55 per cent of the highest price paid. Based upon median prices, 
it might be conservatively estimated that the smallest buying units could 
save one-third of their expenditures for this type of school supply if 
they were able to make their purchases at as advantageous prices as 
are the corporations of larger population. 

A third conclusion, arising from the wide range of prices paid, even 
within corporations of approximately the same size, is that there is a 
difference in the shrewdness of the buyers of school supplies. Some cor- 
porations of small size are able to buy on almost as favorable terms as 
some less careful corporations in the bigger population groups. 

The situation seems worthy of some consideration. We have no 
guaranteed remedy which we could with certainty say would remove 
the burden which this condition places upon some taxpayers. It should 
be evident, however, that one very good influence would be some sort 
of publicity as to prices being paid on a large number of items of 
school supply. Manufacturers in almost every type of business are 
combined into an association which in a codperative fashion furnishes 
cost information to its membership. Yet the average school executive 
has no readily available source of information as to what the neighbor- 
ing city or township is paying for standard items of school supply. 

The case of the state-aid townshins furnishes a peculiar problem. 
Every taxpayer in the state is contributing to the purchase of school 
supplies in these corporations. It is the state as a unit that furnishes 
the support of schools in such corporations. Yet these data show that 
such corporations, judged by median prices paid, are among the most 
uneconomical of purchasing units. 

What is the significance to the taxpayer of this difference in prices 
paid for school supplies? There are 1,016 school townships in Indiana, 
practically all of them falling into the class represented by the units 
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Chart ITI 
Highest, Median, and Lowest Prices Paid for 


6-Inch Felt ERASERS (per dozen) 
in Indiana school towns and cities grouped 
according to school enrollment) 
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of most uneconomical purchasing power. These townships expended in 
1924-25 a total of approximately three and a quarter millions for school 
supplies of the type included in this study. If it be assumed that the 
price paid for a unit item of supply is a reliable index of the cost of 
that item, then it is clear from this study that the taxpayers might 
be saved an amount equal to one-third of the total expenditure for these 
items of school supply, or something over a million dollars. In other 
words, if the existing County Board of Education could be given au- 
thority to purchase school supplies codperatively for the administrative 
area which it serves, over a million dollars could be saved the taxpayers 
of Indiana every year. 








Comparison of the Ability of the State to 
Support Education 


By JOHN K. Norton, Director of Research Division, N.E.A. 


In order to arrive at a quantitative answer to the question, What 
is the relative ability of the states of the Union to support education? 
it is first necessary to measure the economic power of the several states. 

The most commonly used indices of economic power are wealth and 
income. Estimates of the value of the tangible wealth of the United 
States have recently been completed by the Federal Bureau of the Cen- 
sus. This census of wealth estimated the value of all tangible property 
located in the United States and apportioned to each state, with as 
great a degree of exactness as could be obtained, the proportion of the 
nation’s wealth within that state. The difficulties of making this census 
were many, but the results obtained have been accepted as substantially 
accurate by economists of standing. 

There is a wide range in the amount of wealth found in different 
states. New York has tangible wealth valued at approximately 
$37,000,000,000, whereas Nevada has $455,000,000 of tangible wealth. 
Indiana with slightly less than $9,000,000,000 of wealth ranks twelfth 
among the states of the Union in the amount of wealth possessed. 

The National Bureau of Economic Research, a private organization 
located in New York City, recently completed for the first time in our 
history reliable estimates of the income of the various states. These 
estimates cover the years 1919, 1920, and 1921. It is probable, when 
income figures are available over a longer period of years, that it will 
be necessary to revise the percentages of national income allotted to 
the states on the basis of the figures available for the three years named. 
The position of a few states may be changed considerably, particularly 
when affected, during these years as was North Dakota, by cyclic eco- 
nomic changes of an unusual nature. 

As in the case of wealth there is a wide range among the states 
in the amount of income. Residents of New York state enjoy the largest 
annual average income. The average annual current income of this 
state is over $10,000,000,000 as compared with a yearly income of 
$69,000,000 in Nevada. Indiana with an average annual current income 
of $1,683,000,000 ranks eleventh among the states of the Union. 

There is a close agreement in the ranks of the states in average 
annual income and tangible wealth. This correlation is high whether 
one studies it in graphic representation or by the product moment 
method of correlation which gives a coefficient of correlation of .98 
between the income and the wealth of the states. It is possible, if one 
accepts certain assumptions, to combine the figures as to wealth and 
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income of each state in an “index of economic resources.” The follow- 
ing formula was accepted as a basis for combining wealth and income 
in an index of economic power: 

Index of economic resources equals income plus one-tenth the value 
of wealth. 

This index assigns to a dollar of wealth one-tenth the value of a 
dollar of income. 

It is fully recognized that objections more or less valid can be raised 
against the acceptance of this index of economic power. Nevertheless, 
it is believed that it is a more significant measure of the relative eco- 
nomic resources of the state than is wealth or income alone. 

Having accepted several measures of economic power of the states, 
it remains to estimate the size of the educational obligation faced by 
each of the states. The number of children aged 6 to 13 years inclu- 
sive is suggested as a measure of the size of the educational task faced 
by a state. The relative proportion of the nation’s total educational 
obligation allotted to a state is approximately the same whether one ac- 
cepts this age group or others such as 6 to 18, or 6 to 21. 

There is a significant variation among the states as to the per- 
centage of the total population comprised within the ages 6 to 13. Over 
21 per cent of the total population is included within the ages 6 to 13 
in such states as Mississippi, Alabama, and South Carolina. On the 
other hand, less than 13 per cent of the population is included in this age 
group in California and Nevada. Figure I gives similar facts for each 
state in the Union. 

The effect on the cost of education of the variation in the percent- 
age of the population included in these ages is significant. For example, 
California expended $93,000,000 for public elementary and secondary 
schools in 1922. If the ratio of children aged 6 to 13 to the remainder 
of the population had been as great in California as in South Caro- 
lina, and if there had been no change in the cost of educating each 
child, California would have expended not $93,000,000 but $158,000,000. 
Similarly, if North Carolina’s percentage of children had been as low 
as that of California it would have expended not $22,000,000 for public 
schools in 1922 but $13,000,000. 

To arrive at an estimate of the relative ability of the states to sup- 
port education it is necessary to compare each state’s economic re- 
sources with its educational obligations. This can be done by dividing 
the various measures of each state’s economic power by its number of 
children aged 6 to 13. When this is done it is revealed that some states 
have six and seven times as many units of economic power per child to be 
educated as have other states. For example, Nevada has over $45,000 
of wealth per child aged 6 to 13, and California $33,000 as compared 
with Mississippi and Alabama with $5,700 and $5,800 of wealth per 
child. 

The twelve richest states of the Union have three times as much 
wealth per child as the twelve poorest states of the Union. Figure II 
gives figures for twelve rich and twelve poor states of the Union. 

The figures as to average annual income per child point to conclu- 
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sions similar to those indicated by wealth. For example, California and 
Nevada have an average annual current income of more than $7,000 per 
child, whereas Mississippi and Alabama have an annual income of ap- 
proximately $1,490 per child aged 6 to 13. 

If the states are arranged in order of their ability to support educa- 
tion, as indicated by the number of units of economic power per child, 
we may compare the averages of the four quartiles. The twelve rich- 
est states in the Union have something over three times as much 
ability to support education as the twelve poorest states. This fact holds 
true no matter whether one uses wealth, income, or the index of economic 
resources as the measure of the relative economic power of the states. 

In Figure III it is possible to compare the relative ability of the 
states to support education. The ability of the United States as a whole 
is given the value 1.00 and the ability of each state is referred to this 
figure. For example, the map shows that Mississippi has .83 as much 
economic power behind each child as the nation as a whole, while Cali- 
fornia has 2.01 times as much economic power behind each child as the 
country as a whole. Using these same figures it may be said that Cali- 
fornia has 6.09 times as much ability to support education as Missis- 
sippi. This ratio is obtained by dividing 2.01 by .33. 

What relationship exists between the economic ability to support 
education and financial provision made for education? The facts which 
answer this question may be summarized as follows: 

The twelve richest states taken as a group provide 3.4 times as 
much educational support per child of school age as the twelve poorest 
states. 

The twelve richest states pay their teachers salaries 2.4 times as 
high as the twelve poorest states. 

The twelve richest states provide for non-salary costs 3.6 times 
as much per pupil in average daily attendance as the twelve poorest 
states. 

The twelve richest states provide a school plant worth 3.5 times as 
much per pupil enrolled as the twelve poorest states. 

If one studies the forty-eight states by quartile averages there is 
a regular and substantial increase in all indications of financial support 
for education as one proceeds from the poorer to the richer states. 
Figure IV gives the facts on which these statements are based. 

Some data are also available which indicate a similar increase in 
educational efficiency in a state school system and in the level of edu- 
cational attainment of the people in a state as one progresses from the 
poorer to the richer states. 

On the other hand, there appears to be little relationship between the 
ability which a state has to support education and the effort made to sup- 
port education. By effort to support education is meant the percentage 
of a state’s economic power which it annually expends for education. 
Five of the twelve poorest states of the Union make a greater effort 
to support education than the average for the twelve richest states. The 
twelve richest states of the Union have more than three times as much 
ability to support schools as the twelve poorest states. A similar differ- 
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ence between the rich and poor states in effort made to support education 
does not exist, however. The twelve richest states of the Union expend 
1.69 per cent of their index of economic resources for schools as com- 
pared with 1.43 per cent by the twelve poorest states. Figure V com- 
pares the effort made to support education by the twelve richest and 
twelve poorest states. This figure is based upon estimates of the ex- 
penditures for public, private, and parochial elementary and secondary 
schools in each of the states concerned. So far as data are available, 
they indicate that the differences in ability to support education which 
exist at the present time were matched by approximately equal differ- 
ences twenty and forty years ago. Furthermore, there is some indica- 
tion that the states most able to support education at the present time 
were in a similar favorable position twenty and forty years ago. 

It is realized that certain factors not included in this discussion exer- 
cise their influence in determining the ability of the states to support 
education. Among these may be mentioned varying ratios of child to 
adult population. The importance of this factor has recently been given 
some attention by Harold F. Clark in a valuable study published as a 
Bulletin by the School of Education of Indiana University. 

Variations in the density of population and in the cost of living also 
doubtless exercise some influence on the ability to support education. As 
yet, however, but tentative conclusions can be drawn from such data as 
exist as to the effect these factors will exercise in arriving at more exact 
measures of the relative ability of the states to support education. It is 
possible, that when such factors as these are accurately measured, it will 
be necessary to revise considerably the estimates of the relative ability 
of the states to support schools. The positions of individual states may 
be significantly changed. When these factors have been accurately 
measured it is likely that greater rather than smaller differences in 
ability to support education than have been stated will be revealed. So 
far as data now available indicate we may accept the conclusion that the 
states differ widely in their economic ability to support education—some 
states must levy taxes at rates from two to six times as high as others 
to provide a given amount of financial support for each child to be 
educated. 

Detailed data for each of the states of the Union supporting the 
statements that have been made in the above summary will shortly 
appear in the next issue of the Research Bulletin of the National Edu- 
cation Association. This Bulletin will be entitled “The Ability of the 
States to Support Education,” and will be available for distribution by 
May 1, 1926. 
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Age, Grade, and Intelligence Test Distribution 
of Children 


By HERMAN H. Young, Professor of Clinical Psychology, 
Indiana University 





AT the tenth Educational Measurements Conference three years ago 
I introduced the term “developability” to designate the highest limit of 
development which an individual can be caused to attain thru the very 
best organization of medical, social, and educational forces.* Develop- 
ability cannot be measured. What it is can only be inferred from the 
interpretation of carefully collected and especially selected items of in- 
formation concerning the individual. No single item of information yet 
discovered dare be accepted as a measure or even as a reliable index of 
developability. A fairly reliable prediction can be made, however, upon 
the basis of a large number of presumably significant items. The score 
a child makes on a gioup intelligence test when properly evaluated by 
the aid of other significant items may be translated into an index but 
cannot of itself be read as an index. It is merely a crude statement 
of how much the child did on the test. 

Scores on intelligence tests are misinterpreted in many ways. One 
of the most frequent and most vicious is the assumption that if all chil- 
dren are given exactly the same amount of time on a test, say half an 
hour, that the distribution of the scores made within this time limit are 
measures of the children’s developabilities. The argument runs some- 
what like this: that each child was permitted to work exactly the same 
length of time as all the other children and consequently the record 
that he made within that standard time limit could be taken as an index 
of his ability to learn as compared with that of the other members of 
the group. That is, the emphasis has been put upon the fact that a 
standard set of questions was presented by a standard method and all 
children were given an equal amount of time to work. In this connec- 
tion it might be well for us to recall the occasion upon which Daniel 
Webster was so highly complimented upon his superior achievement in 
preparing during the short course of several hours his reply to Haynes. 
To the astonishment of his admirers he replied that he had been pre- 
paring this reply during all his previous life. Exactly the same thing 
might be said concerning the children who take the intelligence tests. 
They should be judged not so much upon the efficiency of their output 
during the 30-minute period but by the length of life prior to that during 
which time they had been preparing to turn out this amount of work 
within the allotted time. With this understanding it is apparent that 


* Young, Herman H. How to Interpret and Make Use of Mental Tests. Bulletin 
of the Extension Division. Indiana University, Volume VIII, No, 11, July, 1928, pp. 26-43. 
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the score made by a child on a group intelligence test may not be taken 
as an index of his developability except as interpreted by the following 
two additional items of information: (1) the specific natures and 
sequence of the environments in which he has lived, and (2) the length 
of time he has lived in each prior to the examination. 

If two children on a 30-minute group intelligence test make a score 
of 50, no conclusions about them are warranted except that they made 
the same score. If we should learn that the test was given under ideal 
conditions as to health of children, correct presentation and scoring of 
test, and absence of disturbing influences, and that they have lived in 
fundamentally the same types of environments and in the same sequence 
and that they are of the same age, we have sufficient data to warrant 
the assumption that they probably have the same developability level. 
If, however, we are told that the one is 8 years old and the other 10 
years old, this bit of information suggests that the 8-year-old has a 
higher developability level than the other, because within the 30-minute 
period allowed, he demonstrated that 8 years had prepared him as well 
for this test as the 10-year preparation period had prepared the 10-year- 
old boy. If these two boys should be in the same class at school it 
would be because the younger one had caught up with the older one 
and is just now in the act of passing him. These two boys cannot be 
expected to remain in the same class very long because the younger 
one is progressing more rapidly than the older. This shows clearly why 
it is unscientific procedure to put children together in the same class 
just because they make the same score or same mental age on an in- 
telligence test. If they should happen to be of the same age the classifi- 
cation would probably be correct. If, however, they are of different ages 
the classification is incorrect. 

A careful study and analysis of the distribution of intelligence test 
ratings according to age and grade groups in regular schools give sug- 
gestions of value in the scientific organization of schools. A careful 
comparison of reports of school surveys made in different school systems 
and by the use of different intelligence tests shows certain characteristics 
of distribution common to all of them. This suggests that some funda- 
mental factors are involved in making them so similar. The limits of 
this paper allow us to present the results of only one or two surveys. 
These results may, however, be taken as samples of trends in the others. 

Table 1, presented herewith, was given at the tenth Educational 
Measurements Conference three years ago. It gives the average score 
for each age-grade group in all grades below high school where there 
were at least 20 children of the Youngstown (Ohio) public schools who 
took Scale A, Form 1, of the National Intelligence tests during the school 
year 1920-21. Because only elementary school children of grades 3 to 8 
were tested, the age averages in the last column on the right of the 
table are for the elementary school children of grades 3 to 8 only. 

Glancing down the column of averages for 3B children, it is seen 
that for the ages 7 to 11 inclusive the averages are 37, 36, 30, 27, and 25 
respectively. Thus there is a decrease in average score with increase in 
age within grade 3B. Similar study of the other grades up thru the 
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8A shows exactly the same relation between age and grade except for 
15-year-old children in 7A. This constant decrease in score with increas- 
ing age within each grade suggests that somehow there must be a 
relatively constant relationship between the developability levels of chil- 
dren and the rate at which they progress thru school. 


TABLE 1 


National Intelligence Tests, Scale A, Form 1: Averages for each Age- 
grade Group having at least 20 Children. 



























































AcE |3B 3A | 4B | 4A | 5B | 5A | 6B | 6A | 7B | 7A | 8B | 8A | Average 
7..........| 87 | | 40 
a, | 36 | 49 | 65 44 
9... .| 30 | 46 | 62 | 79 | 98 55 
a. | 27 41 | 56 | 72 | 87 | 99 | 104) 66 
Wee 2; 25 | 38 | 51 | 67 | 81 | 93 | 105) 115) 130 83 
* ae 7 | | 34 | 46 | 59 | 76 | 89 | 95) 107| 118) 132| 142 94 
Rat | | 44 | 57 | 69 | 80 | 93) 104) 112) 126) 136| 142, 106 
Mi: ss. oh 65 | 77 | 87| 99) 105| 111| 127) 137} 111 
. | 86} 87| 101] 112| 122) 127) 109 
ee | | 134, 114 
Wi iuic. a | 114 
Average... 31 | 44 | 56 | 69 | 80 | 89 | 97 105 111 123 130) 136| Average 


This same fact is shown by following the averages for an age across 
the table from left to right. Thus the averages for 12-year-old children 
range from 34 in the 3A to 142 in the 8B. The averages for the grades 
between these two extremes increase regularly with increasing grade. 
This is consistently true for all grade averages within each age. A hasty 
statement of these observed facts might lead one to say that children 
in higher grades make higher scores because they are in the higher 
grades or one might be led to say that they are in the higher grades be- 
cause they make higher scores. More analytical and deliberate con- 
sideration of the data suggests that children of a given age in higher 
grades are in those higher grades and make higher scores on the tests 
because of having a higher rate of progressing from one stage of edu- 
cation to that of another. Thus within a given age both high score and 
high grade are the result of the same thing, and neither is the cause of 
the other. This statement must of course be qualified by the assumption 
that all the children lead fairly similar lives during their pre-school 
career and were introduced to fundamentally the same educational 
régime at ages 6 and 7 and continued to be given relatively equal op- 
portunities until tested. 

What has been said about the score may be said with equal accuracy 
about the mental age. In fact in the preceding paragraphs the term 
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mental age might be substituted for the word score because a mental 
age is merely a special name for score. 
TABLE 2 


Binet Test Results expressed in Medians for a Class of 59 Children in 
Grade 8A. 








Group | Age | 
| 
Oldest 15 ) | 5-11 | 128 | 80 
Next oldest 13 ¥ ..| 150 | 120 86 
Next oldest 16 = | 146 13-3 | 91 
Youngest 15 ; | 13-8 15-2 | 109 
Youngest 10 | 13-4 15-8 | 114 
Oldest 10... Loe 16-0 12-1 | 76 
 ieccdinaeniteeniibasiibe 
Total 59... | 149 | 132 | 90 
| 


What has just been said about group intelligence tests may be said 
with equal truthfulness about individual tests such as the Binet. Table 
2 gives the results of a survey in which the Stanford Revision of the 
Binet test was employed. It shows that there is an inverse ratio between 
chronological age and mental age of these 59 8A children, also between 
age and intelligence quotient. These relationships are rendered es- 
pecially conspicuous by the fact that the youngest 10 children had a 
chronological age of 13 years and 4 months, a mental age of 15 years and 
8 months, and LQ. of 114, whereas the oldest 10 had a chronological 
age of 16 years, no months, a mental age of 12 years, 1 month, and an 
1.Q. of 76. The median chronological age of the youngest 10 children is 
thus 2 years and 8 months lower than that of the oldest 10 children, but 
the median mental age is 3 years and 7 months higher and their median 
I.Q. is 42 higher. 

At the tenth Educational Measurements Conference at which the 
term “developability” was introduced, the method of translating scores 
of group intelligence tests into standard percentiles was discussed in 
considerable detail. This method requires that when an intelligence test 
is standardized a large number of children of each age must be tested. 
The scores made by children of each age must be arranged in rank order 
and each score must be translated into a percentile rank by calculating 
the percentage of children who fail to exceed each particular score. If 
this has once been done for a large group of children, preferably not 
less than 1,000 at each age, the table thus constructed constitutes a 
standard percentile table. Other children who take the test may be 
assigned percentile ranks by referring their scores to this standard per- 
centile table. The percentile rating thus assigned each child indicates 
the percentage of children who are no better than he on the particular 











gt 


vente © 


EDUCATIONAL MEASUREMENTS CONFERENCE 69 


test used. Thus if a child is rated in the twentieth percentile it means 
that he does as well as the best of the lowest 20 per cent of children on 
that test. It usually signifies that 19 per cent do worse than he. It 
always signifies that 80 per cent do better because the percentile method 
indicates accurately how near an individual comes to being the best 
in his age group on a particular test. It is more valuable than any other 
rating. If individual A rates in the twentieth percentile, and individual 
B in the forty-third percentile, subtraction shows that 22 per cent of in- 
dividuals lie between A and B. It also shows how near each approaches 
the maximum rating of the one hundredth percentile. This is very im- 
portant because it is of much value to know how many individuals there 
are like a particular individual concerning whose disposition we may 
be confronted at any given moment. 

Because of the superior value of the percentile method it is being 
used in the University’s work in the Bloomington city schools. 

A standard percentile table has been calculated for every test used 
to date. The percentile a child earns on each of his tests is recorded on 
his individual cumulative record card. Because as shown at this Con- 
ference a year ago the percentile on one group intelligence test is not a 
reliable index of a child’s developability, we have looked to the median 
of all the percentiles a child earns on the different tests as a more uni- 
versally reliable index than his percentile on any one of the tests.* The 
ideal situation is for all children to have the same number of tests, but 
this is impossible because some children are absent on the days tests 
are given and new children enter the school system from time to time. 
Some children have had only one test while others have had as many 
as six tests. In making the tabulations of the age-grade percentile 
distribution of the children for September 1, 1925, the median percentile 
has been employed in every case where a child had more than one per- 
centile rating. Of course where a child had only one percentile rating 
that was taken. 

The median percentiles of all children of each grade from 1B to 12A 
in the Bloomington city schools on September 1, 1925, were put in a 
distribution table according to age. The limits of this paper permit the 
presentation of only one of these distributions. It is given in Table 3. 
It is for the 8A children. It was selected as a fair sample of the general 
tendencies present in all the other tables. At the tenth Educational 
Masurements Conference a similar table was given for the 5A children 
on one group intelligence test. It shows exactly the same tendencies. 
The percentiles are grouped in intervals of 5 each. This makes a total of 
20 percentile groups. The ages include children who have reached or 
passed one birthday but have not yet reached the next. Thus age 11 
includes children who have reached their eleventh birthday but have not 
yet reached their twelfth birthday. In Table 3, as in Table 1, there is 
within a given grade an inverse ratio between age and success on in- 
telligence tests. The row headed “median” at the bottom of the table 
ree “Young, Herman H. Suggestions on Value and Use of Accumulated Records of 
Group Intelligence Tests. Twelfth Conference on Educational Measurements, Bulletin 
of School of Education, Indiana University, July, 1925, pp. 58-65. 
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shows that within grade 8A from ages 11 to 16 inclusive the median 
percentiles are 83, 89, 73, 48, 35, and 8. The fact that 11-year-old chil- 
dren have a median percentile 6 lower than 12-year-old children must 
not be taken as evidence of real inconsistency because there are only 
two 11-year-old children. 


TABLE 3 


Age-Percentile Distribution of Children in the 8A Grade of the Bloomington 
Schools—September 1, 1925. 


AGES 
PERCE NTILES —_—— iestieiapacideeied anal tcs 
nm: ae mae 15 16 


PAP _ ict 1 

91-95... can Lites: 1 3 2 

86-90... ; 4 4 1 | 

81-85 ee 4 1 1 
76-80 te 1 7 1 | 

71-75 Ae oa Bo 1 “So ie 2 
66-70 5 1 1 | 
61-65 2 a ae 
56-60 4 |} 2 | 
51-55 4 4 | 

46-50 1 a oh 
41-45 2 4 | 
36-40 a 1 ae 
31-35. . mas isn Bao a 
26-30. 21 3 
21-25 te 
16-20........ _ , 
11-15 2 1 
6-10 | | 2 1 
1-5 | 1 
Median he 83 89 73 48 34 | 8 
Cases. . 2/110 | 3 | 27 | 30 3 


There is considerable overlapping of the percentiles from one age to 
another, yet all 16-year-old children rate lower than the lowest child 
in ages 11 to 14. The difference in the rating of the children of the 
different ages is really large when one compares them carefully. No 11 
or 12-year-old child rates below the seventieth percentile. This means 
that all the 11- and 12-year-old children in the 8A rated in the upper 
30 per cent of children of their ages. Half of the 13-year-old children 
rate lower than any 11- and 12-year-old children, yet only two of them 
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fall below the fiftieth percentile. In this connection it should be recalled 
that the standard percentile tables are constructed so that the fiftieth 
percentile is the average percentile for each age group. Over half of the 
14-year-old children fall below the fiftieth percentile. None of the 
16-year-old children rate above the fifteenth percentile. This means that 
all three 16-year-old children in 8A are exceeded by at least 85 per cent 
of children. 

The age-percentile distribution of 8A children given in Table 3 is 
the only complete distribution for children within a grade which will 
be presented herewith. Distributions for all other grades were worked 
out in the same way, and medians were calculated. A summary of the 
medians of these distributions found in Table 4 consists of the medians 
copied from the separate grade distributions. The median percentile 
was calculated for each age-grade group regardless of the number 
of children in the group. It is difficult to know how many children are 
needed in a group to make the median significant. It is, however, certain 
that many of the groups have too few children. In order to give some 
suggestion of the reliability of the medians a heavy line is employed to 
include medians calculated on the basis of at least 10 children in each 
group. Because children may by law stop schoo! on their sixteenth birth- 
day, the medians beyond that age are influenced by the fact that many 
children have left school. 

Comparison of the medians within the heavy lines shows (1) that 
within each grade there is a consistent, large decrease in median per- 
centile from each age to the next higher up to and including age 16, 
(2) that within each age there is a consistent increase in median per- 
centile with but five exceptions from each grade to the next higher one 
up to and including year 16. 


SUMMARY 


The data presented in this paper show that the age-grade location 
of children within the schools bears a fairly consistent relationship to 
the averages of their scores, of their mental ages, of their intelligence 
quotients, and of their percentiles. This relationship may be summarized 
by stating (1) that between any of these values and age there is an 
inverse ratio for children within the same grade, and (2) that there is 
a direct ratio between them and grade for children of the same age. 

This suggests (1) that children of different ages can never satis- 
factorily be grouped together in the same class, and (2) that scientific 
classification of children requires that within each class the children 
should (a) all be of the same chronological age, (b) all be of the same 
mental level as indicated by score, mental age, intelligence quotient or 
percentile ranking on reliable test data, and (c) all be of the same edu- 
cational achievement level as shown by reliable achievement test data 
or other reliable evidence of educational level. 
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Measuring the Ability of the Poor Township 
to Support Schools 


By HaAroLp F. CLARK, Associate Professor of Education, 
Indiana University 


A continuous discussion is going on today in regard to the cost of 
public schools. Without a scientific knowledge of the ability of com- 
munities to bear this cost the discussion is largely fruitless. The neces- 
sary detailed investigations to determine the ability of communities to 
support schools have not been made. Until such investigations are made, 
discussion as to whether schools are costing too much is based almost 
entirely upon opinion. 

The following study was undertaken: first, to obtain some definite 
facts as to the size of the income in a poor township; second, to obtain 
some idea of the effect of income upon ability of this type of township 
to support schools. It must be kept in mind that many factors deter- 
mine the type of school provided in any community. Ability to support 
schools is only one of these factors and income is only one of the factors 
determining ability. However, income is a limiting factor in many cases 
and an important factor in every case. 

The type of school provided in the community where the average 
family income is $400 or $500 must of necessity be different from the 
type that can be provided in the community where the family income is 
$1,800 to $2,000. It may seem incredible that there are communities 
in Indiana where the average family income is only $500. What is the 
ability of such a community to provide schools? Some facts in regard to 
this will be given later. 

A child who happens to be born in one of the poor communities 
has as much right to an education as one born in one of the wealthier 
communities. The people of the community may be just as anxious to 
give it to him. It cannot be done without help. Is the state going to 
help? If so, to what extent? More sentiment than reason has been 
expended in the arguments on this question. Sentiment may ultimately 
play an important part in the answer. In the meantime it is important 
to know the economic ability of one community to support education as 
compared with another community. 

Sooner or later it will be necessary to consider the economic effects 
of state aid upon the poor communities and upon the state at large. 
Under the emotional appeal of the past it has been possible to subsidize 
a community so heavily that it has kept people in an economically un- 
desirable position. 


The Income of the Township 


Before it was possible to consider the relation of income to ability 
to support schools it was necessary to find out the income. The only way 
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we could find out the income was to make a personal investigation in a 
certain community. This was done. The procedure is given below. 

To determine the total income of any community is a problem of 
great difficulty. The difficulties are increased in many ways when the 
community is a farming section. This is easily seen from the difficulty 
in valuing the services and commodities consumed on the farm. 

The first thing necessary was to decide upon a relatively simple yet 
accurate definition of income. It is immediately evident that much of 
the farmer’s income is not received in money, but is in the form of com- 
modities that are consumed on the farm. The milk, eggs, and butter 
that are eaten should be counted a part of the farmer’s income as well 
as what he sells to other consumers. 

The definition of income used was net sales plus wages plus value 
consumed. 

From sales would have to be deducted the amount paid for anything 
used in production; if feed had to be bought for hogs the cost of the 
feed would be deducted from the sales. If the hogs were bought the 
price would have to be deducted. Under sales, care had to be taken to 
exclude the sale of capital assets. The money taken in during any year 
might be greatly increased by selling the farm machinery, the work 
horses, the milk cows, or other stock. In other words, money might be 
obtained by depleting capital. To estimate the capital assets it was 
necessary to make a rough inventory at the beginning and at the end 
of the year. If the capital is about the same at the beginning and at the 
end of the year, sales have been made from production. 

Wages would include any money received from working on the road, 
railroad, carpentry work, working on another farm, or any other work 
from which wages were received. In most places, to the wage item 
would be added profits and interest on investments. In this township 
investigation showed that these items need not be considered. 

The most difficult item to obtain accurately is the value of the 
products consumed on the farm. Records were not kept and offhand 
guesses for the entire year were not of much value. However, if the 
estimates were made on a weekly basis, they seemed to be fairly ac- 
curate. For example, it was possible for a farmer to state the ap- 
proximate number of eggs consumed in a week, but he was at a loss to 
give the yearly consumption. Certain checks that could be applied to 
the estimates showed that they were probably not in error more than 
20 per cent. The error is probably much less than this. 

Net sales, if not depleting capital, plus wages, plus value consumed 
on the farm gives an approximation to the total social income. Even 
such items as pensions and gifts from outside the township were in- 
vestigated but added almost nothing to the total income. 

3y no method of figuring can the total income of the township be 
made much larger than $100 per capita. As will be shown shortly, after 
deducting certain legitimate costs of production, the available income will 
be considerably less than $100 per capita. The total income of the 
township is slightly less than $30,000. This has to support 300 people 
in their public and private activities. It is quite evident that it is not 
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going to allow a very high standard of living. The support of schools 
and of all other public enterprises must come out of this amount. The 
result is that neither the schools, nor the roads, nor any other public 
services are satisfactory. To provide such as are provided makes a tax 
rate almost unendurably high. 


The Wealth of the Tewnship 


The entire township is assessed at about $140,000, approximately 
what a 640-acre farm would be worth at a rate of $200 per acre. Such 
a farm is not uncommon in some parts of the state. What would be the 
conditions if the income from such a farm had to support 300 people and 
build schools, roads, etc., for the entire township? The schools and roads 
would not be very satisfactory and the standard of living probably would 
not be either. 

The true average value of the land in this township in 1925 was 
about $8 per acre. For a recent year the per capita assessed valuation 
was $482 and per child of school age only $1,743. A school tax rate of 
$1 per hundred would produce $17.43 per child. The average expendi- 
ture for schools per child (of school age) in the entire state was about 
$75. To provide even an average school then would take a school tax of 
$4.30 on the $100. This combined with other township, county, and 
state taxes would be so large it probably could not be paid. 


Inability of Township to Support Schools 


That the tax probably could not be paid can be shown from the 
following figures. It would take about $6,500 to provide for average 
schools. The other township, county, and state taxes now amount to 
about $3,000. This would necessitate a total of $9,500 to be paid in 
taxes. The total money income of the township is only about $20,000. 
This includes total wages and sale of all farm products. The taxes 
would take almost half of the total money income. If there is anyone 
here who believes that 300 people in the township could pay over $9,000 
in taxes and live on the $11,000 money income, he is indeed an optimist. 
Someone might answer that the people in the township are not much 
better off now, which is indeed true from one standpoint, but the differ- 
ence is important. Instead of the township paying $6,500 for schools, 
the township raises some $1,500 and the state gives about $2,000 and 
the children suffer the difference. 

It is probable that the state is subsidizing this township and en- 
couraging people to stay in the situation that is not defensible 
economically. We have a township that is too poor to maintain services 
that the state demands as essential safeguards of the state and which 
are the rights of every child. 


Results of Old Methods of Aiding Township 


Lest there be a misunderstanding, before we proceed any farther 
with the argument, let it be understood that we believe every child has 
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the right to and should be given a chance for a satisfactory education 
and if necessary the state should pay the bill. The argument to be 
advanced is to make this more nearly possible rather than the contrary 
which may appear from a careless consideration of the facts. 

Because of the arguments of the sentimentalists in the past the 
state has aided these poor districts. Has it not done so in a manner 
that has tended to keep people in localities that are economically un- 
sound? The evidence is reasonably clear that the state has subsidized 
these people—tended to keep them in economically unsound positions 
when otherwise they might have moved out and have contributed to the 
economic welfare of the state. 

We do not say this should not have been done. We do say that 
it should not have been done accidentally, unintentionally, and under 
the influence of sentiment as it was done. If the state deliberately 
wants to subsidize certain communities, all right. It should not be done 
without a careful consideration of the reasons and the possible con- 
sequences. 

No one is questioning the statement that the state should provide 
educational opportunities for every child in the state. The provision 
should not be made in such a way that the state is encouraging people 
to remain in positions that are economically unsound. 

It is quite possible to construct a system of state aid that will 
guarantee every child a chance for an education and that will be sound 
from the economic standpoint. Indiana has the opportunity to begin on 
such a system of state aid. Will she accept it? 

This discussion has not assumed that the state should not aid poor 
school districts. It has assumed that the state should not give the aid 
in such a manner that it subsidizes certain weak districts and tends 
to keep people there longer than they would otherwise stay. 

It is possible that the best thing the state could do would be to 
try to get the people in a better economic situation. It would probably 
assure a better education for each child. Certainly a system of state 
aid should not be constructed to do the contrary. The present Indiana 
system has this unfortunate result. The same is true in a very large 
measure of even the most advanced plans being considered in other 
states. 

The fundamental principles of state aid will have to be changed. 
The old principles were developed and defended on the basis of sentiment. 
We assume the theory that every child has a right to an education is so 
firmly established that it will not soon be questioned by any American 
state. The theory is correct; the defense is wrong. Assuming that 
the theory of the right to an education is accepted, it is now our duty 
to determine bases for state aids that are sound from an economic point 
of view. Sentiment should no longer be the reason or basis for giving 
state aid. 

There is a fallacious argument that should not be confused with 
the above reasoning. Some will say “Does not the same argument 
hold for the poor parts of a city? Is there not danger of subsidizing 
people in the poor parts of a city and encouraging them to stay in posi- 
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tions other than the best from the economic standpoint?” The argu- 
ment is not the same. It may be that these poor people in the city could 
produce no more if in other cities or in other parts of the same city. 
By and large it is probably true. 

On the other hand, the proof is very strong that the people of this 
township could produce more if they were in a different position. The 
very fact causes some of the people to leave, but the state steps in 
by a subsidy and acts as a check to this leaving. The total income 
of the state would be increased if the people left the township. And 
what is more important, the children would probably get a better educa- 
tion. This latter fact is to be remembered; that the state by an unsound 
system of state aid is tending to keep children in communities where 
they will not have as good facilities for education as if the state did not 
interfere. For, as we have shown, the state subsidy tends to keep 
people in their unproductive community when otherwise they would 
move out. 

This paper began as a discussion of the income of a particular 
township in Indiana. This was the necessary starting-point. Upon the 
size of the income has depended the whole argument, that the present 
system of state aid tends to keep people in unsound economic positions 
when otherwise they would not stay there. The evidence shows very 
clearly that there are townships in Indiana too poor to support a modern 
school system, judging ability on the basis of income. 

In the absence of a complete index of ability to support schools, 
income may be taken as a fair measure of such ability. Probably no 
one will question that a per capita income of $100 is too small to sup- 
port a school system and the other necessary functions of public and 
private life upon an acceptable American standard. The facts showed 
that this township was not able to support the poor schools it had 
without state aid. 

It may not be feasible to have each person in the state in the best 
possible economic position. This is not an excuse for the state en- 
couraging people to stay in very poor positions. With the per capita 
income of the state over $700, a community having a per capita income 
of $100 would be considered in a very poor position. The present system 
of state aid is encouraging people to stay in such a position. If a per 
capita of $100 is too low someone will say, “What is the lower limit?” 
I do not know, but that is no reason for not trying to find out. In the 
absence of complete information regarding some of these factors, the 
least that school men can do is to change the bases upon which state 
aid is given. 


New Principles of Giving Aid 
The new principles of state aid should be based on three fundamental 
ideas: 


1. That the so-called poor community should have returned to it 
what it has contributed. This would abolish most of the so-called aid 
which is not aid at all but simply returning to the community what has 
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been produced in that community, but due to the tax system has been 
collected somewhere else. 

2. That communities which are providing essential commodities or 
services be subsidized on this ground, if necessary, until an economic 
adjustment can be brought about that will pay enough for these essential 
commodities to enable the people to take care of themselves. This will 
not allow subsidies for such large classes as poor agricultural or poor 
mining communities. 

3. That (excepted as stated under two above) all state aid should 
be given in such a manner, that, while guaranteeing an education to 
each child, it will encourage the people of the state to be in or to move 
into the best possible economic position. 

Needless to say, the principles and methods of state aid being dis- 
cussed at this time violate these principles. 


Conclusion and Summary 


We would have the state frankly accept the duty of trying to correct 
economic maladjustment instead of making the situation more or less 
undurable by subsidy. This suggestion will be called visionary by some. 
It is true it will demand much work and in most cases additional in- 
formation that is not now available. This is specially true in regard 
to the income of the poorer communities. 

In the long run this new procedure will be better for the state 
from an economic standpoint, and, what is more important, the children 
of the state will have an opportunity for better education. 

3y way of summary, this paper has attempted to point out: 

1. That detailed investigation into the income of every family in 
a certain poor township in Indiana showed that the total income was 
too small to support the type of school which the state says should 
be provided for every child. 

2. That the state, by an unwise policy of state aid, is tending to 
keep the people in these poor townships when otherwise they would move 
out and probably contribute much more to the economic life of the state. 

3. That the old opinions of state aid developed and defended on the 
basis of sentiment are no longer adequate. 

4. That new principles and programs of state aid can be developed 
that will guarantee an education to each child in the state and will be 
sound from an economic standpoint. 
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Student Attitude toward Examinations 


By Grover T. Somers, Associate Professor of Education, 
Indiana University 


This paper was read at the meeting but is not published herewith, 
inasmuch as a more detailed presentation of the same subject will ap- 
pear as a separate publication at a later date.—Editor. 
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A Cooperative Project 


By WENDELL W. WRIGHT, Assistant Professor of Education, 
Indiana University 


THIs is not a report of a scientific experiment. There were too 
many variable factors, and there was no control group. It is rather a 
report of an experience that has opened to us some problems for ex- 
perimentation and has guided our efforts toward better practical school 
work. The writer with some graduate students gave the Stanford 
Achievement test, Advanced Examination, Form A, a composite test con- 
sisting of individual tests in (1) paragraph reading, (2) sentence mean- 
ing, (3) word meaning or vocabulary, (4) arithmetic computation, (5) 
arithmetic reasoning, (6) information test, in history and literature, 
(7) language usage, (8) spelling, to the 6th, 7th, and 8th grades of a 
Rockville school, December, 1925. At a later date the Otis Self-Ad- 
ministering test was given to the same grades. 

This system is organized on the 8-4 plan with departmental work 
in the 6th, 7th, and 8th grades. The number of pupils per grade averaged 
41. Three of the four teachers concerned in this experiment were rather 
recently trained in teacher training institutions. The town is a county 
seat, agricultural interests predominating in the surrounding vicinity. 
Many of the children come from outlying rural districts. 

The purposes of giving a test in this school were as follows: (1) 
to furnish the writer’s classes with actual schoolroom test material to 
be used in his elementary teacher training classes for instructional 
purposes, in grade school administration classes for an organization 
project, and in supervisory classes for purposes of problems concerning 
improvement of instruction; (2) to aid the teachers in the Rockville 
schools in classroom work and the administrator in supervision of class- 
room instruction; (3) to give a survey of the school achievement of this 
school as coinpared to other like cities and national norms; (4) to deter- 
mine if this type of organization was meeting the needs of the children 
of these grades. 

The tests were scored and other data, such as age of pupils, teacher’s 
estimate, mental age of pupils, type of school, etc., were summarized. 
In general, the results were as follows: (1) all three grades, 6th, 7th, 
8th, were younger in chronological age than the national norms for 
their grade; (2) the mean composite score of the Stanford tests (that 
is, the total score on all tests divided by 10) for each grade was almost 
exactly the same as the norm given for the test; (3) all grades were 
very low in arithmetic computation and vocabulary as measured by this 
test. They were high in spelling and language usage. The 6th grade 
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was very low in paragraph reading. Diagnostic charts were then made 
by the students in my class in elementary school tests and measure- 
ments for each grade of tests 1, 3, 4, 5, and 8 of the Stanford tests. 
That is, a diagnostic chart was made for the 6th grade class of the 
results of the arithmetic computation tests of the Stanford Achievement 
test. This was done also for the 7th and 8th grades and also for the 
various other tests mentioned, making a total of 15 diagnostic charts. 
This, of course, was developed in the test and measurement classes for 
instructional purposes as a means of teaching the class the use of stand- 
ard tests as aids to classroom instruction. 

Diagnoses of errors were made in terms of the thought processes 
back of the errors in as many cases as possible. It would have been 
better to have the child help in this or even do all of it. This was 
followed with suggestions for remedial teaching work, and in some 
cases drill material was worked out by the class. For example, one 
girl in an advanced class in educational measurements got together 
all those aids, devices, games, etc., that have been found valuable as a 
vemedial work in developing vocabulary. Another group developed 
paragraph reading exercises on content material for these grades. An- 
other group analyzed the type of mistakes made by individual pupils in 
arithmetic and suggested methods to overcome these difficulties, and still 
another group developed drill material in language usage, etc. 

The instructor of this class has for a long time felt that the time 
is past when the classroom teacher in any school system should merely 
give the tests, score the papers, correctly distribute the scores, tie up the 
tests neatly, and send them to the superintendent’s office where they 
begin a long and useless slumber. 

Standard tests as an aid in classroom instruction mean that the 
scoring of papers, the distribution of scores, the finding of the median 
is merely preliminary to the real value of standard tests. The real value 
is diagnosis and remedial work. 

With this real live problem before them the class in tests and 
measurements worked out the problem as I have said before and sent the 
results of their work in the form of diagnostic charts and notes con- 
cerning errors made, with suggestions for remedial teaching, and some 
drill material to the teachers of Rockville to be used as they so desired. 

The diagnosis of errors revealed some rather interesting bits of 
information concerning these three grades. For example, in arithmetic 
computation it was revealed that of approximately 130 pupils that took 
the test, 110 of them could not correctly multiply 4679 times 68. Further 
diagnosis of this problem indicated that certain fundamental errors were 
present. First, they failed to multiply correctly, that is 8 times 7 equal 
56 was in a very large number of cases called 54. There are those who 
would want to excuse this on the grounds of carelessness. The better 
answer is probably half-learning or learning without a motive or chance 
to use in any life situation what had been learned, all of which has been 
so well discussed in the addresses of yesterday and the day before. 
Second, a very large number failed to carry correctly in this problem. 
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Another problem, one-fourth of 828, was missed by almost two-thirds of 
the pupils. The errors in answer were of two types, 27 instead of 207 
and 202 instead of 207. These were further diagnosed into the errors 
in thinking. 

In the vocabulary test the sentence is given, “To be wretched is 
to be (proud, silent, swift, unhappy).” The word “proud” was underlined 
by 108 of the 130 taking the initial test. 

is 
| ar 
“are” by 24 of the 6th grade class of 44. 

I do not need to speak further of outstanding errors that were 

- indeed surprising to almost everyone concerned with the initial test. 


In the language usage test “The news bad today” was marked 
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Fic. 1. Mean Scores in the Initial and Final Tests of the Stanford 
Achievement Examination (Forms A and B) Rockville Schools, Sixth 
Grade, December, 1925, to March, 1926. 


Test Initial Test Final Test 
1. Reading: Paragraph Meaning................ 60 69 
2. Reading: Sentence Meaning ................ 43+ 48 
RFS re FI Sc cc ccccccwarseceen 44 48 


PE SE NON es ce rer scdbetsesccveredes 146 165 
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Arithmetic: Compmtatio® 22.00.00 cccssccscces 100 
MES TI on gavin ssccpecseeneeus 66+ 
TOCA! APAmets BOONE occ cc cvicsceevececves 167 
ature Siudy ad Beene. «0c. cvcccsceccoce 45 
History and Literature .....ccccccccvncccceess GOT 
ND SEINE 5. 6 h6:0 consid et wean eee uewe we 25+ 
PU SII io. o.niic v0.0 Sb0h doe ware nds veo 116 
SEE SEIN oreo Save nxxd pad oa eed ae ee 12-1 
Sot Tot _ 6 7 8% 9 ‘ize “ACR 


Fic. 2. Initial and Final Test Scores—Seventh Grade, 


1925, to March, 1926, Rockville Schools. 


— 


Test Initial Test 
Reading: Paragraph Meaning .............. 72 
Reading: Sentence Meaning ................ 50 
Reading: Word MeGWime ...< 25 cccsicsccesvce 45 
TOE TONE BOOED Soin cc noo baci ccesecdanws 169 
Avitmeetic: COmGtetioh «oso. cc cccccccccccc 117 
ees SINE oe i's Six once rao wicca 83 
TOC BPUARMOC BOOEE « occsinccccceesdccceves 200 
Nature Study and Science ..........scccecees 59 
| er rrr rye 45 
ee Ee On Pe ee 33 
I NID 5 sc ccipabuns sande keeeed 138 
IE FE Site nctonas sincere wecvntebes 13-3 
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Fic. 3. Mean Scores in the Initial and Final Tests of the Stanford 
Achievement Examination (Forms A and B) Rockville School—Sixth 
Grade, December, 1925, to March, 1926. 


Test Initial Test Final Test 

1. Reading: Paragraph Meaning .............. 78 83 
2. Reading: Sentence Meaning ................ 54 58 
Bs. “UNE I foes cowie sea eaes 55 59 

FU I CN 5 ec wiaiv'es esate cexeen's ee 187 200 
4. MAveiemeiie: Cametie cc ccc cciciesec esses 122 139 
GC, epee S IE oo nk ki caved sevescess 90 100 

ee 212 239 
6. Mature Stade and Besemes. «oo csscccccvciccees 62 68 
Te BE Se BND Swkikde Htc addinn nnwesens 53 55 
ID f'n bh towed wadsss pa eenn saci 37 37 
i Pe SD sid cawed 5k ewe wes os om aoe 160 163 

IN i ca a Oe a a 14-4 15-2 


After about 3 1/3 months of school work, during which time the 
teachers of language, arithmetic, and reading worked on improvement in 
these lines, Form B, an equivalent form of the same test, was given. 
Figures 1, 2, and 3 [shown at conference] show the results (shown 
above). The mean scores in initial test are indicated on these charts by 
the continuous line. Reading from left to right that line represents the 
mean score in Test 1, paragraph reading, Test 2, sentence meaning, Test 
3, word meaning. Then the total of all reading tests is taken together 
and charted in terms of the grade standard. That is, for example, the 
first chart, which is that of the 6th grade, should be read as follows: 
In Test 1, paragraph reading, the 6th grade made in the initial test a 
score equal to the standard of the 5th grade .8 thru their year’s work 
in reading. That is, changing the initial test score, which you will find 
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at the bottom of the page, in reading paragraph meaning, into terms 
of grade standards, it is 5.8, altho they should have been at that time 
at about 6.3. Then just above the continuous line you find a broken 
line on this chart. Looking at this 6th grade again in Test 1, reading 
paragraph meaning, you will find that at the end of the 3 1/3 months 
at the time they were given the form B of this test, their grade then 
rated equivalent to 6.7 thru the grade. So on thru all of the test. The 
vertical distance between the continuous line and the broken line repre- 
sents the gain or loss in each test of the Stanford Achievement Com- 
posite test made by the various grades in Rockville. Figures 1, 2, and 
8 have much in common, so far as results are concerned. If you look 
at the total reading score in the three tests you will notice that the 
average gains of approximately .9 of a year were made in the reading 
work as measured by this test in 3 months. In arithmetic computation 
there was an average gain of almost 1% years in less than 4 months. 
In language tests, Test 8, all grades averaged a slight loss. All other 
tests received no particular attention in diagnosis or remedial work. 
The gain in these tests as you will note was relatively small. In grades 
6 and 7 the mental age as measured by group mental tests and the mean 
chronological age are practically the same, while in grade 8 the mean 
mental age exceeds the mean chronological age. It is still more interest- 
ing to note that the mean educational age as measured by this achieve- 
ment test exceeds the mean mental age by an average of 5 months in 
the grade. 

The mean educational quotient, that is the relation between the edu- 
cational age and the chronological age at the time of the initial test, 
was 105, at the time of the final test it was 107. The A.R., that is the 
relation between the I.Q. and the E.Q., is for the initial test 103, for the 
final test 104. 

The papers were then divided on the basis of I1.Q. of each pupil, 
that is, those below an I.Q of 100 as revealed by the Otis Self-Ad- 
ministering Mental test were thrown into a separate group. Those with 
I.Q. of 100 or above were thrown into another group. Then the gain 
of each group was figured in reading, arithmetic, and language tests. 
The results were as follows: 

1. The gain in reading was slightly more for the low I.Q. than for 
the high I1.Q., that is, considering the total reading scores. 

2. In arithmetic computation the high 1.Q., that is, those above 
100, made a gain of 6.5 in score more than those with an I.Q. below 100. 

3. In the language tests the gain was slightly more for those 
whose I1.Q. was below 100 than those whose *I.Q. was above 100, altho 
there seemed to be very little correlation between these two measures as 
revealed by the tests. 

Then grouping the I.Q.’s into 4 groups, those below 80, those from 
80 to 100, 100 to 120, 120 or above, and comparing their scores on the 
achievement tests gives us this interesting comparison. The average 
gain in each group was practically the same with the exception of the 
small group with an 1.Q. below 80 and and the small group with an 
I.Q. above 120. Neither of these groups made an average gain of any 
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consequence. That is, whatever gain has been made in the composite 
scores was made with the average group with an I.Q. of between 80 
and 120. 

To these results we can both “point with pride” and “view with 
alarm.” To certain results in arithmetic computation we can point with 
pride. The average gain made by the 3 classes in this short period is 
much more than would probably have been made without diagnosis and 
remedial suggestions. However, in language usage we must view with 
alarm these results. Because of the fact that the language teacher 
was most interested and willing to codperate and because it was in this 
part of the test, it seemed to the writer, that diagnosis and remedial 
work should be most valuable to the pupils and the teachers, the failure 
is suggestive. The accompanying table shows the results of the initial 
and final tests in language usage. The lower 50 per cent are those who 
fell below the median on the initial test. The upper 50 per cent are 
those who were above the median on the initial test. 


Lower 50 Per Cent on | Upper 50 Per Cent on 
Initial Test Initial Test 





| Lost on | Gained on Lost on Gained on 


final test final test | final test | final test 


18 19 | 





Sixth grade ie 3 2 

Seventh grade... . 5 | 15 18 2 

Eighth grade... . ef 15 17 | 2 
; at ee Ee 

6 
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This table shows that those who made below the average score in 
language on the initial test increased their scores by the time of the 
final test. Out of the 60 who made low scores on the initial test, 48 
gained on the average about 7 points, which is equivalent to more than 
one year of gain. The upper 50 per cent of those in the initial test 
lost on the final test, and the average loss was slightly more than the 
average gain of the lower 50 per cent. Those who made low scores 
on the initial test gained, those who made better than average scores 
on the initial test lost, and the loss and gain were practically equal. It 
is evident to any of us that the type of instruction methods and de- 
vices used in this class were helpful to those who were poor in the 
initial test. But it is equally apparent that the same type of instruc- 
tion method used or devices used were injurious to those who were above 
the mean to start with. 

The language test, Number 8 of this series of tests, is made up 
of 60 exercises which measure both common grammar errors and errors 


7. 





a | ah A LPR 


~— 





einibartna trend. 











ee 


ok ee ea ke 





EDUCATIONAL MEASUREMENTS CONFERENCE 87 


in diction or choice of words. There are 30 exercises given to each 

. 2 6 of is \ ” “ f saw) 
type of error. For example: “The news | are | bad today” and “I | seen f 
him do it.” These of course are examples of typical errors in which 
we should call for this purpose grammatical use of words. “I think 


{ game }\,, os endure | ;;_,, 
\ sport | and “I can hardly { stand J him 


are examples of diction or choice of words. A study of the errors on the 
initial and final tests according to this division was made. That is, 
dividing them into what we may call grammar errors and errors in 
diction shows that the gain made by the poorer students, that is, those 
who were below the median in the first test, was made on grammatical 
errors. There was practically no gain in diction. 

Form B, or the final test, does not repeat the same examples as 
are found in the first test except in 4 or 5 cases. In these we again 
found that these pupils who were low in the initial test had practically 
removed the errors. There was about the same amount of errors with 
the upper group. It seems to the writer that there are at least 3 
possible causes of these conditions: 


dominoes is an interesting 


First, the class was not segregated upon their ability in’ language 
usage as shown by the initial test. The group was handled as a whole. 
The emphasis has been put on the error side of the language usage 
teaching. Drill was used for the purpose of creating a consciousness 
of errors to correct an old habit that was incorrectly formed. This 
same emphasis has disturbed those whose language usage was good. 
Those children whose language usage was above the average to start 
on might have formed correct language habits in the home or in the 
lower grades of school. At least these habits had been formed and 
therefore out of their conscious mind. Drill for them on errors they 
did not make naturally would result in confusion. The teacher knew 
who needed the most help and used such methods and devices as ap- 
pealed to the lower half of this class. These same methods and de- 
vices confused the upper half. It is at this point that we are now 
ready with the beginning of the next school year to make some controlled 
experiments concerning this question in this school system. May I sug- 
gest that no one is more interested in this experiment to be carried out 
next year than the classroom teacher who carried on this experiment 
this year. 

Second: This low score in language usage about which I have been 
speaking may be due to the fact that the tests did not measure what 
the teacher has taught. For instance, much of the work of the 8th 
grade and some of the work of the 7th grade has been spent on tech- 
nical grammar. This test does not measure that, and there is some 
question whether it even measures the results of it. The teacher also 
interested the children in this room in the study of words from more 
than one point of view. The methods and devices that he used were 
his own, plus those given by the class in tests and measurements sug- 
gested for developing a vocabulary. Most of the gain obtained from 
vocabulary or word meaning as indicated by that part of the reading 








88 BULLETIN OF THE SCHOOL OF EDUCATION 


test was made possible in the language class. The reading teacher 
was interested in methods of increasing paragraph reading. She was 
not interested in developing vocabulary, and therefore much of this work 
fell to the language teacher. It was, however, not adequately done. 

Third: There seems to have been little motive to work offered to 
those already fairly good in their language usage. There was devel- 
oped very little motivated work on language usage altho there was 
some motivated work on word meaning. Language usage work was 
not tied up with life activities. A codperative experiment now being 
carried on thru the Bureau of Coéperative Research of 6A grades in 
Bloomington, Bedford, Brazil, Greencastle, Mitchell, Salem, Sullivan, 
and Washington thru the superintendents of schools and their teachers 
in each of these cities dealing with this problem will be concluded this 
spring. This, with some work being done in Crawfordsville, will give 
us further evidence on this matter. 

Without going into detail in any of the other parts of this study 
it can be said that the exceptional pupils both as revealed by the 
Stanford Achievement test and the mental tests are lacking in some 
opportunities that should be afforded them. For example, a boy in the 
7th grade whose I.Q. was 125 and whose E.Q. was 160 ranked approxi- 
mately 3 years ahead of his grade norm. A girl made within a few 
points of a perfect score on the initial test of the Stanford Achieve- 
ment test. She has an I.Q. of 126 as measured by a group test. That 
grade had very little to offer either one of these or 10 or 15 others in 
the three grades. Acceleration has been practiced with success with 
these same children. They have been accelerated one and two years 
already. They will be further accelerated at the end of this school 
year. However bright the hope of enrichment on the same level may 
be, it is not now practiced in our school systems, except in rare instances, 
without some change in organization. 

Enrichment for the bright pupil in the ordinary elementary school is 
not at present practiced. Administrative organization so that a pupil 
can carry more work, or do his regular work more rapidly, is the only 
successful plan that we are now using in the ordinary run of schools 
to meet the needs of the bright working pupil. Approximately 15 per 
cent of these pupils could profit by that change in organization and 
will profit by such a change in the near future. 

This experience that I have just related, with the possible exception 
of the part concerning the language tests, is an experience which should 
be going on continually, at each step refining and reworking our meth- 
ods to obtain better results, at each step getting nearer the democracy 
in education that we heard about last night. It might seem to you 
that it is a waste of time to go thru this experience without having 
first set up certain definite and exact procedures to be followed. It is 
my opinion more and more that we must work with teachers in the 
field as we do in a class here and not have them working for us. When 
the teacher arrives at the point of seeing the need for more exact 
scientific procedures it will then be easy to proceed. Now these teach- 
ers are asking for a more developed and scientific method of attack on 
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the problems that they did not realize existed before. It is our oppor- 
tunity to proceed. 

The teacher training work, the training of administrators and su- 
pervisors done in the University, needs more of the practical school 
problems in its course of study. The day is not far distant when 
those training for administrators and supervisors will be required to do 
practice teaching in their own line with some of you well-trained ad- 
ministrators and supervisors all working under the guidance of the 
University. The popularity of the work of the Extension Division of this 
University, in which the instructor meets the teachers in the midst of 
this problem, has convinced me that much teacher training must be done 
in the field. The eagerness with which student teachers work on prac- 
tical problems connected with the schoolroom has convinced me that 
your problems are our problems and are not in the least different, 
except in our approach to them. That is to say, your problems as a 
school teacher, as an administrator, as a supervisor, the solution of 
which will better the opportunity for educating children, are the prob- 
lems that ever should be our concern in teacher training. Your problems 
in the field can best be worked out in the field in connection with the 
University. It is, then, a codéperative project from which both will 
benefit. 

In this codperative project which I have described to you, and of 
course it has been a very small codperative project, the value has many 
times exceeded its cost in time and money and work. I believe this 
kind of project, codperative working of those in the field with those at 
the University on the problem of the schoolroom, is the biggest future 
in our education work in the coming years. 








A Test of Animal Husbandry 


By Z. M. Situ, Director and Supervisor of Agricultural Education in 
Indiana 
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PURPOSE OF THE STUDY 


1. To prepare achievement tests in animal husbandry and apply 
them in practice with a view to their standardization ultimately. 

2. To demonstrate to teachers of vocational agriculture that 
achievement tests may be made valuable as examinations and as aids 
in teaching. 

3. To demonstrate to teachers of vocational agriculture a method 
of procedure in preparing and administering achievement tests in voca- 
tional agriculture subjects. 


SOME USES OF ACHIEVEMENT TESTS 


The following uses of achievement tests were pointed out to the 
teachers who were requested to codperate in giving the tests in animal 
husbandry: 

A. Some Values of Achievement Tests as Examinations: 

By using this type of examination 

1. the subject-matter can be covered comprehensively and thoroly. 

2. the energy of the pupil is devoted to thinking rather than to hand- 
writing, grammatical construction, spelling, or other items that the 
examination is not intended to measure. 

3. the results are precisely the same no matter who the examiner may 
be. The personal opinion of the examiner is eliminated. 

4. all irrelevant factors are eliminated. 

5. a large number of small units are covered instead of a small number 
of large units. 

6. time on the part of the pupil is economized. 

7. time on the part of the teacher is economized. 

8. pupils can be tested frequently. 

B. Some Values of Achievement Tests in Teaching: 

By using this type of examination the teacher 

1. must give very special attention to the preparation of the questions. 

2. must set up definite objectives for the course and for each division 
of the course. 

3. can with definiteness and profit review the examination with the 
class in a limited period of time. 

4. can measure with a high degree of uniformity the effectiveness of 
his teaching. 
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can more reliably compare the achievement of each pupil with that 
of every other pupil in the class. 

6. can test the class more frequently than by using the old type of 
examination. 


METHOD OF PROCEDURE EMPLOYED 


1. After conferring with animal husbandrymen on problems in their 
respective fields of swine, horse, beef cattle, and sheep husbandry, and 
with teachers of vocational agriculture, the writer prepared outlines of 
study for each of these four phases of animal husbandry. 

2. With these outlines and Plumb’s A Study of Farm Animals as 
a basis, the writer prepared achievement tests in animal husbandry as 
follows: . : 

a. True-False Test—Twenty Questions 

b. Single Recall Test—Twenty Questions 

c. Recognition Test—Ten Questions 

Plumb’s A Study of Farm Animals was used because 42 of the 59 
teachers were using it as a textbook. 

3. The writer prepared instructions for giving the tests, a key for 
use in scoring them, and a statement on some values of achievement 
tests as examinations and as aids in teaching. 

4. Copies of all matter specified in paragraphs 1, 2, and 3 above 
were sent to each of the 59 teachers of vocational agriculture in Indiana 
who were teaching animal husbandry. The tests were mailed on Novem- 
ber 14, 1925, with instructions to give the tests and return them to the 
writer on or before December 1, 1925. The tests were given within the 
period specified. 

There were 627 boys in vocational animal husbandry classes in 59 
high schools in Indiana tested. 

5. The tests were administered by the 59 vocational agriculture 
teachers to whom they were sent. These teachers scored the tests ac- 
cording to instructions and returned them to the writer, who checked a 
sufficient number of the scores to test adequately their reliability. 


DATA FROM THE TESTS 


Data from the tests are tabulated in Tables I, II, III, and IV. 

In Table I are the median scores and number of cases for each 
age group from 13 to 20 years, and the median scores with number of 
cases for each group classified by school grades 9 to 12. 

The median scores for the groups classified by school grade indicate 
rather definitely that the total test material is well balanced with respect 
to degree of difficulty in relation to school classification. The median 
score for the 9th grade is 23.25; for the 10th grade, 26.29; for the 11th 
grade, 27.8; and for the 12th grade, 29.19. The total possible score is 
50. The median for the four grades 9 to 12 inclusive is 26.5. 

Table IV shows that there is wide range in the degree of difficulty 
when the questions are compared with each other. 
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Some interesting questions are raised by the data for the age groups. 
For example, why is the median for the 13-year-old group the highest 
of all the medians in Table I, and why is the median for the 20-year-old 
group the lowest of all? Also, why is the median for the 17-year-old 
group lower than the median for the 16-year-old group? 

It is significant that the 7 boys 13 years of age are from 5 differ- 
ent schools and that the 10 boys 20 years of age are from 10 different 
schools. It is highly probable that in the main the median scores for 
each of these two groups can be accredited to mental ability. The small 
number of cases in each group practically eliminates comparison with the 
other age groups in Table I. 

Table II shows the total distribution of scores by school grades. 

Table III shows the total distribution of scores by ages in years. 

Table IV shows the distribution of right, wrong, and blank answers 
for each question. 


TEACHERS’ COMMENTS ON THE TESTS 


“Enclosed you will find the tests as you requested. I think they are 
a very great help. The students were well pleased with them. Part 
of the work had not been covered. The tests can be used to measure 
more effectively in the future.” 

“IT would like to see this tried in other subjects, too. It gives us 
some idea of how well our boys are getting the work. I gave this test 
without any reviewing or without notifying the boys that they were to 
be tested.” 

“This is the first test of this type my pupils had ever taken, but 
the procedure was so simple that I am sure the results would have been 
the same had they been familiar with this kind of test.” 

“The test seems very satisfactory and correlates very well with the 
average grades for the pupils tested. They all feel that they will make a 
much higher grade on the next test. Standard tests have been used 
very little here.” 

“The achievement tests in animal husbandry went over good with 
the class.” 

“The grades do not reflect the score that these boys would make 
four months from now, because only a part of their animal husbandry 
work has been covered.” 


THE NEXT STEP 

The next step in the process of developing and standardizing 
achievement tests in animal husbandry is now under way. An attempt 
was made to prepare a set of tests of the same kind and of the same 
degree of difficulty as those given in November. These tests were mailed 
to the 59 teachers who coéperated in giving the first set of tests. The 
material was mailed on April 2 with instructions to give the tests and 
return them to the writer on or before April 10. The papers have been 
returned and are being checked. 
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It is planned for next year to attempt to prepare for administering 
at one sitting two sets of questions of the same degree of difficulty. 
These tests will be given the early part of the year to beginning classes 
in animal husbandry. Near the end of the year tests will be prepared 
and administered under the same general plan used this year. 


TABLE I. SMITH AGRICULTURAL INFORMATION TESTS 
IN ANIMAL HUSBANDRY 


Median Scores Made in November, 1925, by Boys in Vocational 
Animal Husbandry Classes in 59 Schools in Indiana 


Ages Median Scores Number of Cases 
eS o> en ee ee 7 (From 5 different schools) 
As aon oe ce aera ed oe 23.16... . 
BRERA iced ane ; +: die <i Ae 
per box enthter quia’ a enussa canes ff re 164 
ee = ee ear > > ee 
i ; sien sepals a a one 79 
19 = siete bho sa oeallic wg ba 
20 oe ni die ekalats shbvec > Geet ae .. 10(From 10 different schools) 
Ts oo Kova ck akon cc aaeneeee he 627 
Grades 
Digs te doh abs oes oe eek eae 28.26........480 
10 SiS ek a ee eee 26.29 191 
_. aa i.iv be aio a aanie aon aes calico . - Cae .. 148 
le sa huis ou Kebmeaie Chk ee eee , Jere 99 
MNS Vira adn 'cwhivtawxeke mea aes Ms conicis 623* 


*Four of the 627 boys did not give their school classification. 
TABLE II. SMITH AGRICULTURAL INFORMATION TESTS 
IN ANIMAL HUSBANDRY 


Scores made in November, 1925, by 623 Boys in Vocational Animal Huse 
bandry Classes in 59 Schools in Indiana. 


CLASSIFICATION IN SCHOOL 


(Number of cases indicated in vertical columns) 


ScorEs 9th Year 10th Year 11th Year 12th Year 9th to 12th 
Inclusive 
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TABLE III. SMITH AGRICULTURAL INFORMATION TESTS 
IN ANIMAL HUSBANDRY 
Scores made in November, 1925, by 627 Boys in Vocational Animal Hus- 
bandry Classes in 59 Schools in Indiana. 
AGES IN YEARS 


Scores 13 to 13.50to 14.50 to 15.50 to 16.50 to 17.50 to 18.50 to 19. 
13.49 14.49 15.49 16.49 17.49 18.49 19.49 20. 


(Number of cases indicated in vertical columns) 


50 

49 

48 l 

47 1 

46 2 

45 2 3 

44 1 1 

43 2 1 3 

12 1 2 

41 1 1 

40 ; 1 | 1 

39 1 4 3 1 

38 1 3 ] 1 

37 l 2 5 1 1 

36 2 3 1 4 

35 2 1 8 7 1 

34 l 7 4 7 1 1 

33 1 3 4 6 2 1 
32 1 l t 2 7 2 3 

31 1 3 7 6 5 2 

30 ] 2 5 12 ] 6 2 1 
29 1 3 5 12 6 10 2 1 
28 3 1 8 5 6 2 

27 l 3 9 11 6 1 3 

26 17 a 14 1 3 

25 1 7 1 14 2 2 1 
24 2 8 8 7 7 3 

23 3 9 2 7 

22 4 6 5 4 5 2 

21 2 3 5 2 2 1 
20 1 6 5 3 2 3 1 
19 6 3 3 1 1 
18 l 1 3 4 6 4 2 

17 7 3 2 5 4 4 1 1 
16 3 8 8 2 l 1 
15 3 4 4 2 1 

i4 1 2 3 2 

13 l 3 2 2 1 
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13 to 13.50 to 14.50 to 15.50 to 16.50 to 17.50 to 18.50 to 19, 
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TABLE IV 


Distribution of Right, Wrong, and Blank Answers for Each Question as 
Answered by 627 Boys in Vocational Animal Husbandry Classes in 59 High 
Schools in Indiana, November, 1926. 


| True-Fatse Test |Stnaue RecaLn Test, RECOGNITION TEST 
| 














Question > ~ | — 
Number | | | 
Right Wrong) None Right Wrong) None Right, Wrong) None 
| | | | 
1 534 69| 24] 364] 201 62} 259| 365| 3 
aS, 13} 1] 423] 183) 21| 539] 84 4 
eae 51} 7| 136] 312| 179| 282] 331 14 
ae 216; 390| 2 32| 421] 174] 279| 341 7 
A. | 528 85| 14] 180| 238) 209 | 281 | 311 | 35 
Reo, ......| 483] 139] 5] 262| 270] 95] 425] 196] 6 
es 139} 13| 142] 323] 162] 447 171| 9 
- RRO 508 114 5| 98| 306] 223| 407| 205; 15 
9............| 543] 79] 5] 232] 283] 112| 455| 162/ 10 
i kivecescock Ae Tan 4| 280} 171| 176| 497| 121 9 
a 544 71 12| 178 | 297 | 152 
ae 498 | 106; 23] 110| 396| 121 | | | 
- ae ....| 369} 245 | 13) 266} 169] 192 | 
_ ee el ee 5 | 336 128 | 163 | 
ee S 39} 6) 251) 204) 172 | | 
* SES 529| 91] 7| 103] 321| 203 | | 
eee i $| 204] 281] 142] | 
DGnasecns 550 63) 14 76 344 | 207 | | 
19............| 486} 124] 17| 203] 243] 181 
AE 512 103| 12) 34} 212] 381) | 
Totals... ../9.919 | 2,405 | 216 |3,910 | 5,303 |3,327 |3,871 | 2,287 | 112 


Per Cent...| 79.1 | 19.1 | 01.7 | 31.1 | 42.3 | 26.5 | 61.7 | 
| 


36.4 | 01.8 


DIRECTIONS FOR GIVING AND SCORING THE SMITH 
AGRICULTURAL INFORMATION TESTS 


DIRECTIONS FOR GIVING THE TESTS 


General Directions 


1. Seat the pupils to be tested in a room to themselves. 

2. Remove everything from the tops of the desks. 

3. Do not permit the pupils to be disturbed while writing. 

4. Arrange the test papers in piles—one pile for each row of pupils, 


and set of tests for each pupil. 
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5. Have the first pupil in each row serve as monitor for his row. Upon 
the signal “Distribute papers” have monitors distribute the papers, 
one set to each pupil. 

6. Before giving the signal, caution the pupils to leave the papers on 
the desks exactly as the monitors place them. 

7. Instruct the monitors to place the papers with Page 1 up and with 
the top of the page nearest the pupil so that the letters on the page 
will be upside down. 

8. Do not permit the pupils to communicate with each other or to ask 
questions. 

9. Provide each pupil with a well-sharpened pencil. The examiner 
should have an extra supply of sharpened pencils so that he can 
instantly supply a pupil with one should the pupil’s pencil break. 

10. The examiner should remain in the front of the room and give his 
attention to keeping time and to seeing that his instructions are 
followed. 

11. Explain to the pupils that the tests are short and that there is a 
time limit on each test. 

12. Encourage the pupils to do their best. If a pupil cannot answer a 
given question, he should go immediately to the next one. 

13. Caution the pupils not to hurry unduly but to work as rapidly as 
they can. 

14. The examiner will allow exactly 10 minutes each for the True- 
False and the Recall Tests and exactly 5 minutes for the Recognition 
Test. 

15. Count time from the signal ‘‘Ready. Go.” Use the second hand 
to count time, if a stop watch is not available. Always start on 
the minute. 


Test I. True-False. Page 1. 


When the examiner is assured that everything is in readiness for the 
distribution of the test papers, he should instruct the monitors to stand. 
Hand to each monitor his quota of the papers. Again caution the pupils 
to leave their papers as they will be placed by the monitors, and again 
instruct the monitors how to place the papers. 

Now give the signal to the monitors. “Distribute papers.” 

As soon as the papers are distributed and the monitors are seated, 
the examiner will say, “Hold pencils up.” (Each pupil should obey in- 
stantly.) “On page 1 are twenty statements. Some of them are true 
and some are false. After each true statement you are to write the 
letter Y (meaning ‘Yes’) on the line in the margin. After each false 
statement you are to write the letter N (meaning ‘No’) on the line in 
the margin.” 

“When I say ‘READY. GO.’ you will turn your paper so that the 
letters will be right side up. You will then read the instructions and 
proceed at once to carry out the instructions. When I say ‘STOP,’ you 
will please stop immediately.” 
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The examiner will give exactly 10 minutes from the time he says 
“READY. GO.” 

Now give the signal. “READY. GO.” 

At the end of 10 minutes say “STOP. DO NOT TURN THE SHEET 
UNTIL I TELL YOU TO.” 


Test II. Recall. Page 2. 

Continuing, the examiner says— 

“On the opposite side of the sheet on which you have been writing, 
you will find 20 statements. One word is omitted in each statement. 
You are to write on the line in the margin after each sentence the word 
you think is omitted. You may now turn your paper over. When I say 
‘READY. GO.’ read the instructions and proceed at once to carry out 
the instructions. READY. GO. (The examiner will allow exactly 10 
minutes from the time he says “GO.”) 

At the end of ten minutes the examiner will say “STOP. DO NOT 
TURN THE SHEET UNTIL I TELL YOU TO.” 


Test III. Recognition. Page 3. 

Continuing, the examiner says— 

“On page 3 you will find ten true statements. At the end of each 
statement is a group of words in parentheses. Only one of these words 
in each case is the correct one. Each word within the parentheses is 
numbered. You are to underscore the correct word in each case and then 
place its number on the marginal line at the end of the statement. You 
may now turn to page 3 on your second sheet, but do not begin until I 
give the signal. You will please hold your pencils up.” 

The examiner will be sure that each pupil is ready. Now give the 
signal “GO.” 

The examiner will allow exactly five minutes from the time he says 
“GO.” At the end of five minutes he will say “STOP.” He will then in- 
struct the pupils to turn to Page 4 and to fill in the blanks. Insist that 
each one write his full name clearly and that he give accurately each 
item of information for which the blanks provide. Permit no communica- 
tion and no delay. 

As soon as the blanks are filled in the examiner will instruct the 
pupils to lay their pencils on their desks, and will instruct the monitors to 
collect the papers and hand them to him. 

The examiner should score the papers and record the scores for 
reference and comparison later in the year when the second set of tests 
will be given. 

After the papers have been scored and the scores recorded, please 
mail the papers in the enclosed stamped envelope, which is addressed to 
Z. M. Smith, Purdue University, Lafayette, Indiana. 


INSTRUCTIONS FOR SCORING 


Place the test paper over the KEY FOR SCORING in such a manner 
that the right-hand marginal lines on the test paper correspond exactly 
in numbering with the lines on the KEY FOR SCORING. 
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Check with red pencil the answers that are wrong. 

In Test I, True-False, the number right minus the number wrong is 
the score. Ignore the blank lines or answers unattempted. That is, do 
not count them at all. If the number wrong either equals or exceeds the 
number right, the score is zero. Each question counts one point. 
Record the score in the top right-hand corner of Page 4 on the line in- 
dicated thus, Test I 

In Test II, Recall, the number correct is the score. Count only 
those that are answered correctly. Each question counts one point. 
Enter the score in the top right-hand corner of Page 4 on the line in- 
dicated thus, Test II 

In Test III, Recognition, the number correct is the score. Count 
only those that are answered correctly. Each question counts one point. 
Record the score in the top right-hand corner of Page 4 on the line 
indicated thus, Test III 

In the three tests there are 50 questions. Each question counts one 
point. Therefore, the possible total score is 50. 











SMITH AGRICULTURAL INFORMATION TESTS 
in 
ANIMAL HUSBANDRY 


TRUE-FALSE TEST 


1. Sincere devotion to animals tends to develop in one sympathy, 

broadmindedness, and resourcefulness. 
2. Domestic animals are of importance to man because of their 
use for food, clothing, labor, and maintenance of soil fertility. 
Where farmers raise the most live stock, there the crops are 
less abundant and the people less prosperous. 
4. The value of farm manure from farm animals in maintaining 

soil fertility was known and emphasized more than two thou- 

sand years ago. —— 
5. An animal, family, breed, or race that transmits its special 

characteristics with much certainty is prepotent. — 
6. Forms of inheritance that do not concern the stockman are 

color markings, speed, temperament, fecundity, milk produc- 

tion. —— 
7. The importance of community breeding of livestock can be 

overestimated, for it does not represent improvement and 

progress in breed promotion. ae 
8. Climate, food, and man have each had but little influence on 

the development of breeds of animals. os 
9. The characteristics of the Shorthorn are very marked. The 

color is red, red-and-white, or a mingling of red and white 

hair forming what is called a roan. ——_— 
10. Skim milk is not as valuable food for calves as is whole milk, 

because whole milk will grow stronger frames and will pro- 

duce growth more cheaply. —— 
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The margin in beef-cattle selling is influenced by first cost, 
first weight, cost of gain, delivery to feed lot, marketing, time 
of year, feed conditions. 

Commercial wool is graded into three great classes, namely: 
clothing wool, of short, fine staple; combing wool, somewhat 
coarser than clothing and ranging from two to eight inches 
long; carpet and knitting wools, which are coarse and long. 
In the seale of points for judging wool, the following are 
relatively unimportant: quality of fineness, condition, length, 
soundness, purity. 

The five features most highly rated in the scale of points for 
judging fat hogs are form, quality, condition, hams, and back. 
The work of the horse and what he can accomplish depends 
upon his weight, his muscular development, and his endurance. 
Boys’ and girls’ club work has not increased the interest of 
boys and girls in farm life. 

The udder is of minor importance in the scale of points for 
judging dairy cows. 

The influence of quality in beef production is of great im- 
portance. 

The body of the dairy cow should be thick at the chest, but 
not deep. 


Dairy cow testing associations are relatively unimportant. .——— 


SINGLE RECALL 


The state that ranks first with numbers of horses and swine 
in the United States is 

The item of first importance in the relation of animals to man 
is the use of animals for 

One thing of great importance found in stable manures that 
is lacking in commercial fertilizers is —_——— 
The men who have been most noted in the development of 
each of the great breeds of livestock have placed a premium 
on uniformity of character and 

The process in operation among wild animals by which in- 
dividuals choose or select their mates is 

The fat of the animal body is composed of the same chemical 
substances as the fat of plants, but differing in combination. 
These substances are oxygen, carbon, and 

The first step in calculating a ration for farm animals is to 
find out the amount of dry matter, digestible protein, total 
digestible nutrients, and the 

in the ration to be used. 

The work of a horse usually consists of a more or less complex 
combination of hauling a load, raising the body, carrying a 
load, and 

The three features given the most credit in the scale of points 
in the score card for fat cattle are form, condition, and 
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There are three distinct classes or groups of sheep. These 
are fine or short, long or coarse, and 

11. The Poland-China breed of hogs originated in 
The five features most highly rated in the scale of points for 
judging bacon hogs are ribs, back, shoulders, quality, and 
The scientist recognizes two great classes of selection in rela- 
tion to animal life, namely, natural and 





. The consecutive relationships of an animal to its ancestors are 
shown in a record called the 


With reference to feeds for animals the opposite of roughage 


is 


stand the relationship of form to 
Feeds most desirable for horses vary according to condition of 


age, locality, and 


. The efficient judge of live stock is one who can see and under- 





wools. 











There are two methods of vaccinating hogs—the single and 


the 





The harness of the horse in its simplest form consists of the 
saddle, the breast harness, and the 
Carbohydrates exist in the body of an animal in two forms, 


glycogen and 


RECOGNITION 


. The world’s leading stockmen are the people of (1. Germany, 
2. United States, 3. Denmark, 4. 
The largest livestock market in the world is (1. 
2. Tokio, 3. New York City, 4. 


Great Britain, 5. France) 
Liverpool, 
Omaha, 5. Chicago.) 


The breed of dairy cattle that predominates in the southern 
states is the (1. Holstein, 2. Ayshire, 3. Jersey, 4. Brown 
Swiss, 5. Dual Purpose Shorthorn.) 
Most of the food digested by an animal is absorbed from the 


(1. stomach, 2. the large intestine, 3. 





the small intestine.) 


The scientist who first proposed that animals be fed daily 
certain amounts of digestible protein, carbohydrates, and fat, 


such as were actually 


Armsby, 2. Kellner, 


3. Wolff, 4. 


required by the animals was (1. 
Henry, 5. Lehmann.) 


The breed of cattle that most closely resembles the Shorthorn 


in size and weight is the (1. 


3. Galloway.) 


Aberdeen-Angus, 2. 


The leading wool-producing part of the world is (1. 


America, 2. Russia, 3. Australasia, 4. 
The Berkshire hog is a native of the (1. 
Russia, 3. China, 4. 


Hereford, 








North 


South America.) 
United States, 2. 
England, 5. Egypt.) 





The leading state of the United States in the production of 
swine is (1. Illinois, 2. Nebraska, 3. Iowa, 


Missouri.) 


4. Indiana, 5. 


Of the following animals, the one with the largest stomach 


capacity is the (1. 
ox.) 


sheep, 2. 


the horse, 3. 


the hog, 4. 


the 
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KEY FOR SCORING 


Test I, True-False Test II, Recall 


TesT III, Recognition 








1. True 1. Iowa 1. Great Britain 
2. True 2. Food 2. Chicago 
3. False 3. Humas, vegetable 3. Jersey 
4. True matter 4. Small intestine 
5. True 4. Prepotency 5. Wolff 
6. False 5. Natural selection 6. Hereford 
7. False 6. Hydrogen 7. Australasia 
8. False 7. Nutritive ratio 8. England 
9. True 8. Locomotion 9. Iowa 
10. False 9. Quality 10. Ox 
11. True 10. Medium 
12. True 11. Ohio, or North 
3. False America 
14. True. 12. Form 
15. True 3. Artificial 
16. False 14. Pedigree 
17. False 15. Concentrated 
18. True 16. Function 
19. False 17. Work 
20. False 18. Simultaneous 
19. Bridle 
20. Lactose 





